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ABSTRACT 



TMt rMMtdi te»Mi9tHi tfw IMi of Mo im m n tm ihouid mauM 
m MruciloMl tout iwl iMdi iWi (mgIi « mtnuiii or loxibooka). It 
locuMt on on Impofliiil •ubcomponom of M lowmng: chooolno tfw right 
pfocoduro M ri0M Nmo. tOMfilna lo olioooo tfio rtQM proc«luro lo 
dtticuli to tMto tuoh 01 tMino a oonx^m booMOO tht oowwdloft bMwMO 
iMl^MfW Qooli and At QOfMrto pioooduroo doooriM to • mMiuil to ofion 
obOMft. rmtoormofo. wmm prooddufoo hovo itoiMiir lunctlont. U to 
dMcUi 10 lol whicli ono to bool lor a ptritotitot itoioilon. to ordor to 
faoMaio too Joctoton prooooi. toainioilOMi lona awy toduOt o^^co about 
wtion 10 uao partloiitor pfOCoAM and may iMaio toa advica wito 
asanylot Tho raMMb rtponad two in i m i l Qa nd ton aNact of vartoui 
tofiM of advlea on toanwa* abalagtoa it/ ohooatng a procadura. 

Subfada road ona ol loar *^afitoiia of a mmttH lor a oompuior gama caM 
aox-Wortd. Thraa «antoi:a eomatood advtoa aboii vbion to uaa pantcutor 
OMMa prooodurta; toa advtoa imo aMiar mmi m a almpla varbol aria a 
atobofaiad wtiK ona of too lypaa of anMptoa. Ttia fourth varoton contalnad 
no ad^. Sibjacia toan paifonnad torM toika: a lacai totk. a racognwon 
iMk (La.. »i Ci t w ttoato ^ ba n m a n ooirooi and tooonad applcaaiora oO too 
•dMtoa). and a daditon took (Lb.. aoMng probtoma tor wMch tha odvica waa 
fttovani). 8tf jfacto who aaw oartoto tomia of too advloa tolowad It to aatod 
• pocadura Howavar. at*|aoto who aa«r iw adrfoa wara aqMOly abia to 
aolM lha probtotoo oonacly. Exaaiptoa ha^ Mb|aoto ldan% corraci 
a pplcaiton a of toa addoa. but dM not tocraaaa adharanoa to toa advtoc 
dMrino probtom aoMng. Tha raauNa auggaat thai advtoa dooa not raquira 
alaboralton wito axamptoa. but IMhar raaaarch to raqubad on how aut>|acts 
totorprat advica and dadda to apply b. 
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Chapter 1 

INTRODUCTION: DESIGNING EFFECTIVE TEXTS 

H«lpino wrHtrs to prcxSuct mort oMtctlvt i«xts is an unponant got! of both 
wrMnQ (Mdago^ and rtitarch oo documtnt datlgn Ttw sUdUng point in iht 
prtv<oui MManca to. of courst. th« pNm mor* tM^ftv* WTiai niakts ont ttxt 
mor* tNtciivt than anoihar? Rhttoridant know that ih« tim of t (Macourst may bt 
10 Uttinjct. dtight. movo or portuado itw rttdaf. in tomo sonst. than, a mora 
aftadiva taxt limpli carhai tha author's hiianMon hjrihar: iha parsuaslon Is daapar or 
tha da^Qhi is oraatar. "Hiis way of (ooklng at affactlvanass prasupposas two things: 
Nrst. that you can isoUia axactty what tha taxt is suppovsd to accompMsh. and 
sacond. that you ChI maasuta tha atfad of tha taxt on tha raadar 

For soma typas of taxi, it is not at aN aasy to daclda what sffaci tha taxt is 
supposad to hava. For axampfa. warary taxts might not hava any datarmmata. 
'intandad' affactt. so iha qusstion of affactivanass may ba irraiavant or it may 
dapand antiraty on which thaory of HtaraKjra iha raadar adopts Evan whan tha 
discoursa has an IdantiflaMa aim. tha affact xi tha raadar may ba diHicult to discarn 
or ntassura. Argumant. lor axampia. aims at changmg tha raadar 's baliafs it is 
difflcuit, howavar. to maasura tha axtant to which a parson has baan parsuadad by a 
iakt. slAca a chan^a in btHafs may not always maniftst itssit m tha radar's bahavior 
In a pradlciablf way. or in maasurabla dagraas 
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Functional documanis. nspaciaMy instructional taxts. hava two quailtias that maka 
tham partic.itar>> accasiUbia to rasaarch oo affactivanass First, functional documanis 
hava at iaast soma ovate, dstarmlnata goals. For axanp«, tha instructions (o; ma 
1040 tax form ara intandad to halp paopla fW out thalr tax ratur.i corractiy A 
compmar uaar's manual is intandad to halp paopla laam to roarata tha computar 
$0. whHa a hmctional documant can canaimy hava hiddan aganda. tha primary goals 
0^ tha documant ara usuaNy quita axpttdt Sacond. hjnctional documanis hava 
obsarvtbla maasurabla affacts on thair raadars. Ahar raading tha taxt. paor - 
shoulr: ba abla to do somathlng that thay simply couldn't d^ bafora (or couidnl do 
as tvaH) * Tharafora. it Is ralatlvaly aasy to daclda whathar a functional taxt is 
9tt%xjf^. or which of tm functional taxts is ntora affactiva An affacttva taxt haips 
pac^ laam to do somathlng. A mora affactiva taxt hclpa paopla iaarn to do that 
somalMng mora aaaMy and quicMy. with fawar mistakas or probiams Bacausa 
functional taxts hava thasa quaWlaa. H is possibla to axplora tha taaturas that 
distinguish affactiva taxts from Inaffactlva onaa. 

My long tarm goal Is lo davalop prindplas for dackUng what to say and how 
much to say in an Instructtonal taxt in ordar to taach a skm most affactivaiy For 
Iha purposa of this work. 1 wHI Hmit tha tarm insiiucuontt fxt to includa such taxts 
as gaomatry taxtbo.4(S and computar usar's manuals, which amphasiza skill 
padormaoca and probiam solving, but axcluda '.axis such as history books and 
nawspapar articiiis. wh<ch ptaca morj amphasis on thi acquisition and synthasis of 
Infotmatlon. An lmpcrl<nt assumption of Iha work is that prlnclplaa fnr daalgning 



Ol»viou«t)f. aequliiAg i tkHi In «ny ifu« Mntt (•qudn i Qiitl d«»r oi Hitlhiod uptiitAci 
How«v*i. \%ttr*nq iht ifitvtAt conc*pll. pilnciplft trxl pioctduifl m vfib«l form It # common And 
•Imoil lAdi«p«nubl« HrM tt«p. n AndMton (lOS3) polrtli ou4 
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mMrueUm^ ttxta muM Im oraunM bi a cognMM modtl ol wtwt Mormatlon p*op»« 
M#d 10 pmhm tUi and Iww ihty utt M fciwwHdg< lo construct and rtfln« 
tm miMal procadMrM. TMa mik ihar«tor« drawa haavey on cogoMvo ptychology 
lor iiooitaa ot tan procaaajng and afcM laaming arid for aiparlmantal maino<L< of 
aw^hiadnQ aUH parformanca uadac dMarani laamlnQ condMona (mat ia. how waN 
raadaca can parlorm naw akMvt aliaf aiiM^ftng dW lani InalriicilorMi laxta). 

1.1. A Nola on M«thodolooy 

H racani yaara. ihara haa baan a nwawa m away from analyzlnQ laxta as 
laolaiae t anHacta and toward ^Mutng taxia aa part ol a oomplax ralatlonattip aniong 
tlia wf1iar» tha raadar, m$ asiamal attuadon baino wriiian about and thw taxt tt>ai 
daaortbaa it (a.a* YoMng. taohar k Ma. 1970: iQnnaavy, 1171). Tlifa movamam haa 
Mluanoad dia way In which idita ara awaiuaiad; mora and mora, tha mtandad raadar 
Is baIno IndoM In dia p rocaaa. Ona axampla ol iNa Irand la tha growing populaitty 
ol hoNadc acortng lor awaluatlng writing abMty. Many paopla baNava that hoMsilc 
acoring is mora vaMd than aoeatad analytic maaauraa bacauaa k aaaita a natural 
raaponaa to a taxt from a raadar (Chamay. tM4a). Simiarty, mora and mora wrHara 
d fcrn^donal documani a ara taUng dia aanalbia aiap ol aaaing what a leal parson 
actual^ laama from raadhig dialr documania' 

U aa r iaaiin o (or dia *uaar-adlt.* aa Adaa* tMO. larmad k) haa baan an imponam 
davalopma m for bodi raaaarchara and pracdtlonara of documam daalgn. By obaaivlng 
typloal mambara of dia targat audlanca uaing a documam to partorm a typical task, 
wrliara gam valuabia Monnadon about whara dta documam worfca and whara it 
doaan^ WMi dta addition ol ihMilng-aloud proiocola (aa uaacrlbad. for axampla. In 
Swanay. Jandi, Bond ft Hayaa, tMt: SuMvan and Flowar. lordtcomlng: and Chamay. 



t9e4b) uaar-tasttnq can also suggast causaa for tha proMma and point lo possible 
sokillons. Rapaatad cyclas of taailng and ravlslon can rasuH in highly affacttva 
documanis. 

Tha primary goal c} uaar-iaating la to malia IndMdual documania mora affactlva 
Tim primary goal of ttMa disaariailon. howavar. la to davalop ganaral princlpias for 
craating affac /a mstrjctlonal laxta, Conaaquantiy. ihia dlaaanaUon sats tha usar- 
laadrtg approach within an axparimanial framaworlt. By sysiamaUcakV controlling iha 
laaturaa In varloua varalona of a taxt and comparing wfiat ;aadars laarn from tha 
ddlaram varalona. wa can gain a batK' undarsianding of which faaturaa ara moat 
Importam and wtiy thay hava tha affact ihay do. 

TMa diaaartatlon la ralatad bodi to cognlilva paychotogy and to tha work of 
matructlonal daalgn ihaorlsts such aa MarrHI (t9(3) and Ralgakith ft Stain (t963) 
tnatructional daslgnars hava davalopad a famHy of Uiaorlas about tha Cast forma of 
Inatructton. Uka cognUlva paychofoglsia worklr<« In Uta Information processing 
paradigm. mstrUctlonal daaignars bagki wHh a dataMad analysis of tha lask thct 
laamara ara to parform Tha ob|actlvaa of iha two approaches differ, however, 
information procaaaing modela aim at daacrlbing how paopla naiurally gc about 
aolving proMama In order to Hkimlnata human mamal rtaources and capacities 
tnatructional design ihaorlas aim at gukUng learners to ao^e problems In the opiimal 
way. So. after aatting wvan-de'lned performance obiectlves. an instructional designer 
selacia. alaboratea and organizes Information In ways praacribad by hia or her theory 
10 create Inatructlonal maierlala for achieving t^ioaa obfactlves. in this dissertaiion. 
tha Imaraaia of compoaltlon teachera. msiructkinai daaignars and cognitive 
paycf>ologlais overlapt In order to teich people to wriie effective function:.! texts, we 
can benefit from research on how people ieem aa weN as research on optimal forma 
of Inatructlon. 



1^ An OfVikm of lh« Dimmtior 

Ifm rttMrcti In docum«ii dttlon thai hu adoptttf an •xptrlmanfal m«tl>odoioQy 
hM NMinly loouMd on two Mrit of goalt: maUno lt» MocmtMon In tTM taxt oular 
10 M and moklno tfw lnlofwia<on ooalor lo undaraiand. So, a groat doai o( 
rtonuMani daalfln wortc hoa iMMorad m nrrtiianM wOh la^iiiksal lamsuaaa or on 
ooncomo Mco tio rolo of loMao of comoma and Mcoo. or pago layout and 
lypography (0.9.. WrtgM. 1977. %%n, i9t3; OuHy I Kabanco. 1902. Kloraa. lOeS: 
and roooaro h roviowod In Foftor. litO). An Importam laauo Oioi hat no< rocoh/td 
anough attoMlon la Oio laauo* of Mormadon coniont Mnda of Information 

•houW an mamidlonal loxl Indudo? How much ahould bo oxplolnod and whai form 
thouM dw oiplanaiiona or oHho ra dona tafco? 

TNa id aaiiia d on la port nf a largor raaoarch prolaci dioi t o cu aao on Mormotlon 
OOMOM and.*ln pardcular, on t^o rote of alaboradonp In aMi loofrtng (Rodo/. Chomoy 
ft Moiaan, In prooa). Chaptar 2 tooglna by proao»»dno dio iradMonal viow of 
No nn ado n comoM. ^ mm rovtovia roaaorch «ai polnia 10 a moro'comptox viow of 
dw rola of otab ora rtona lor joridno • tidi from an moMicdonal loxt. My partlcubr 
tocui la on ar, Importam auboomponom of iaamino a aMI: laamino to chooao tht 
rtgM proooduro at dw rtghi Hmo. Chaptor 3 imroduooa dio problam of toioctktg 
appfoprta to procoduroo. why dila la an Importani problom and how advico and 
aiamptao in an inairucNonol toxt might hoip poopla loam a aolactlon atraiogy 
Chopiar 4 daa gf lbia dw oxpodmantal modiod of dw roooorch ahidy on advico and 
oxamplao. Tht ' ^ouda of dto aludy aro proaamad and diacuaaad In Chaptora 5 and 
1. mnaly. Chaptor 7 proooma aomo concluding romarka on dio Impicailont of ttia 
raaoarch for documom daalgn> Including goala for hduro raaoarch. 



11 



Chapter 2 

THE ISSUES OF CONTENT AND ELABORATION 
IN INSTRUCTIONAL TEXTS 

In Mt €tm0im. I m UMli Wm wmonH vltw on t» com^m of mttructkMMl 
Itxit. Wm ^ tM tM poM thouM to txpMMd m co wptof <MM. Afttr 
prttiming mm rtMont lor tfoubHim Mi iradMonil wlidom, t brMly rtvtow 
tOfM tiyirtwifllil rMMfCD M.lMtfi lo • fflor* oomplM ^rftw: M <<ibOf> t >orw m 
omr mtdad lor certain Mndi of imormotfon Nitl roMo lo a spocWo oompooom «l 
•W loonnnov 

2.1. Tlw TradltkMial Vi«w on ContMit 

TIM iradMonil vlow on comom lo ihoi an' bwrucHoMl loxt for novlcoo thould 

muwi MIo or no prior knowMoo- tlr mm titould bo ao complolo and aa axpNcH 

aa poaaMo wMi dataHad a« pian ai ion a of ovwy rolovani point TNa poM ol vlow lo 

haM by wmaia of boii taxttooka and taamictfonal manuala. Tauawonho (1979). tor 

axan^la. ouMnaa aovaral lavala of daiaM tor do cu mommg eompulor aofiwaro. TDo 

Mghaal livai of doial la calad tor m whal ha labola *Claaa A documomatlon/ whtob 

ha doaoiihaa aa toaowo! 

daaa a documomadon la iha moot daiaaad; » eomalna apacMo daNnWona 
and daialad daacnpdona of avary algnMcani factor or Nam idiMn ma 

aofiwara apacMcadon nn toval of daiad probaWy Undo Ma moot 

appH c abW ly In uaar manuato, and ilohdy ao: Thd whar of a uaar manual la 
oaiwraNy unavaNabto tor conaiMlon. 90 dia uaar naada iha OKira daiaN. 
ITauawordw (1979). pp. 19»-199.| 
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T()la is a good statamant ol tha traditional wisdom But. as it often happans. 
lhara la Qdod raaaon to doubt tho traditional wisdom For ona thing, raai computar 
uaara apparanily don't Hka to raad lor)g. dataMad mstrucUonal manuals Thay'd rathar 
aak aomaona to show iham what to do or try lo flgura M out thamsalvas (Scharar. 
1993). Furtharmora. PlroNl and Andarson (1985) hava obaan^ that avsn whan tha 
laamara do raad tha taxi, thay draw on ralailvaly Nnla of this information dur'^g task 
partormanca. So from this pomi of viaw. provkJlng complaia and daialiad instruction 
aaama of Wda practical vakia to tha laarnar. 

A aacond raaaon to doubt tha tradHlonal wisdom Is provldad by rasaarch m iha 
fact-laamino domain. In a aarlaa of tan axpadmama. Radar and Andarson found that 
aublacta wfw studlad a fun tongih taxtbook chapiar parformad worsa on 
comprahanaton and zacaN lasts than subjacta who had atudlad aummarlas ihat wara 
ona^ M tong (Radar I Andarson. 1990: Radar I Andarson. 1982: Allwood. 
Wlksirom 8 Radar* 1982; Radar. 1982). 

Radar. Chamay 8 Morgan (1984. and m prass) axplaln thasa rathar surprising 
raauaa M a comblnailon of* two phanomana. ona kivoMng encoding and tha othar 
ratdaval. Tha encoding phenomenon la tha waN^uwwn Total Time Law (Bugeiskl. 
1982: Cooper 8 Panda, 1987): Tha mora lima and atianilon a parson spends 
studying a panknilar fact, tha better ho or she wiN learn M. So. reading elaborations 
m tha taKi divarta time and aitantkNt away from tha ntam pomta. On the other 
hand, aiudylng a summary aMows the reader to devote fuH attantk)n to exactly those 
pomta that need to be remembered. The encoding phononmanon Is not ihu whole 
atory. howavar. In one atudy. Rader and Andaraon (1982) equated the total time 
aublacta apand studying the main points. The sub|ects In tha alabcrated group spent 
extra lima studying the elaborallona. Presumably, the encodings for the main polnta 
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m both oraufM w«r« tqui M y tirofio btcauM tub^eii m both oroupt tp«nt tn« tarn* 
•mount of tfmo Mudylno tfiom. but tfwro wu MM a tlonNlcam advtntooo tot mo 
iu w wu i y oraiip> 80. «io Nmicap ol tfw •*obofiltono tooms alto to kivotva a 
aaoond p honowoiW K roirio«aL tfw loamor Iriaa 10 rairitvo tho mam pointa of 

a toid from mamory. tho alaboratlona cauaa InMrfaranoa (Andaraon. 1074: Radar A 
Andafaon* IMO). 

IHa Mlnga from tlw lact-laarnino domain auQoaal ihai alaboratlona tmrt 
p rn k mnmm «4Mm iha laamar'a goal la 10 undaraiand and ramambar tha mam poima 
of • laxL But Nfiat happana wban iha goal la 10 apply tia tocta. 10 uaa Hmn to 
ao^ pfOMama. aa m aW laanrino? Wa know dial laamara doni «• having to raly 
on oompmar manuala. but H'a an opan quarton ndiy oonpular manuala and othar 
mamicdonal laxta ara ao u n aaH a fa cioiy. M could ba that audi laxia teN to Nva up 10 
dia iradMoficJ wladom: dial la* diay aiauma loo much prior hnovdadga and ao don't 
c onnbi anough m form a do n . 0? II * could ba durt Hwy contain too much Inlormatlon 
dial dlnra ftia atiandon away from dia aaaandal Ma; diat la. dta advamaga of 
aummarlaa ndghi apply avan In dia aUi taanMng domain. 

2:2. RdSMrch on did Rold of Etaborationt in Skin Lddrnfng 

To laai whadiar alaboradona halp or hurl akM laamlng. wo conducind a atudy on 
dia uaar'a manual lor dia OWi Oparadng Syatam (00$) of dia ISM ParaonU 
Compuiar (tor a mora c o m plaia rapon J dila amdy. aao fladar. Chamay t Morgan. 
Itd4 and m ^9m). Wa rawroia part of dia original IBM manual (Anonymoua. 1963) 
10 mduda tfia daaraai and moai ralava.4 alaboradona wa could dUnk of. auch aa 
daiaNad axplanailona. analogaa, mafa ata iaman u . axamplaa of commanda, and ao on. 
TMa 'alabor ai ad' varalon of dio manual cama 10 about 40 pagaa. Than wa craaiad 
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a tacond. *unalaboratad* varsion of Iha manual by simply daieting all of the 
alaboratlona. Thia manual cama to about t2 pagaa. 

Eighty novica computar uaara wara givan up to an hour to raad ona varsion of 
dia manual and wara told ihat ttia manual would not ba avaUabia to inam afiar iha 
raading parted waa ovar. Ahar tha mjbjacta raad iha manual, thay wara askad 10 
c$iny out a aat of four ordinary taaka 00 tha computar: ranaming fllas. craailng 
aubdiraciorlaa. copying and dalatlng Waa. and w on. As tha sublacts workad. tha 
compuiar kapi a racord of ovary command thay typad and tha tlma at which it waa 
antarad. Tha maaauraa of how waN aubfacta parformad wara whaihar thay wara abta 
to do tha laaka and how aftldantty thay workad (ag.. how much tlma thay took and 
how many commanda thay Isauad). ' 

Had of ma aub|acta. tha 'Cafora' group, wara glvan advanca Information about 
tha laaka thay wara going to parform. balora thay raad tha manual Tha '^ftar' 
group aaw ttw task mstructlona only attar thay had tmishad raadkig tha manual. 
TMa manipulation was Includad m ordar to aimulata two common laarning situations 
Somatmiaa laarnars hava axpHcM goala m mind and turn to instructional materials 
apaclflcaMy to find Information ralavant to ihoaa goals At othar ttmas. paopta coma 
to laam a naw sklN with only a ganara! Idaa of how thay wW maka usa of what thay 
laam. Wa apaculatad that alaboratlona pruvklad m tha taxt might ba lass vaiuabta to 
ttia Bafora group, who coukS prasumabty ganarata thair own task-spacifk: aiaboraltons 
whHa raadlng. 

Wa found mat tha varalon of tha manual d<d not atfact tha numbar of tasks 
aub)ac(a couM complata. suggasting aubjacia couki laarn anough from any of tha 
manudia to complata moat of tha tasks. provkMng that tha tlma lor working on tha 
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iMks «M not tmtkA^d. Howv^, «• <lld M mmiKm In how •HldiifUly tubj^ctt 
«MfM. Subltdt pofloriMd tttm if tlaboft lto n wtrt tvaNtblt. •MMr •laborttlont 
m ih« ttxi or oliborailoni tfwi Nioy go n o rt iod itiomoolMO O bMod on •di-anct 
ItfMNMQO of tfw tMkt: ilioy wort lioior at porlonnlno tfw uti« « * lituod lowor 
ooiNMMdt. Howovor, having oihtr ono of iiooo wurooo of oloboraHono wot 
auMciom: hovino boNi oiaboraNona m tia taxi and aMnoa fc now^doa M noi booat 
pactamianoa abovo ona of ttiaaa aoufoaa alona< 

Far aoma maaauraa, wa found thai lha ahoiK/, onala b oraiad manual worM waN 
far aublacta who had advanoa l aw wladga of !fia tajha. Howavar. (ha raamia In 
9anaral aupport iha Uaa dial manuala ahould co nta in aiabarado n . flaaltKcaiy. wa 
cani aaauma thai 9$ laamara wM eoma In «Mi auoh daaily daHnad goala aa iha 
Bafora graup autf oia. in fad. dia worn parfonwanoa ahwaya cama from aubjacta 
who had nojalaboradona avalabla. La., aub|acia who aiudlad lha una^aboratati manual 
whhom advanca ho ow ^ dga of dia taafca. On balanca. dw«a laama ra wara Impadad 
mora by d«a undar alaboraiad lana Ihan dw mora goakdlraciad laamara wara by tha 
owaraiaboraiad varalon. M tm palm, dian. dw baoi airaiagy would aaam to ba to 
play II aafa ind provlda alaboraiad Imarucdon to ad laamara. 

80 tbaaa raauda aaam 10 aupport iha iradMonal wMom of gMno novfsaa 
complaia axplanatona of al d)a ralavani poima. UtnOfiunaiaiy, wa cant lay iha 
qmdon 10 raal haro, ainca Carrod (I9d8) did a falFV timliar ahidy d>ai producad 
o onttodnQ raaulu 

Caivod and odiara hava adopiad a naw phloaophy toward lna«ructional manuala. 
dia ao caNd MMmalai fiHoaophy. 'Jaalgnara of ao^aNad 'mMmaHai tralnino 
maiartala' procoad on dia aacumpdon dial kiairucdonal matariala should acMvaly 
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•ncouraoa dlacovofy ^arnin^ by provkUng aa Httla proaa aa poMlbia Carroll put mis 
prindpia into praciica in a tutorial rrianual for a commarcJal word procasaing systam 
tha IBM Olapiaywrltar Syttam) and producad a ;«vlaad manual that wai on* fourth 
tha lao^h of iKa ortgln&l. CarroN'a pdodplaa for ahonanmg iha manual Includad two 
mfor aiapa. ¥\nt. ha cut cm avarydiing ha conaldarad irralavam to dia taik at hand. 

...aNnHnaiing ail rapailUon. al aummaita;. ravlawa. and praciica axarcisas. 
tha Max. and tha troublaahooiing appandlx. ..AN matarlal not ralatad to 
doing offlca work waa aNndnatad or radically cut down (ttia walcoma to word 
prgcaaamg ovarviaw. daacripdona of tha lyatam atatua Una. daiaila on tha 
ayaiam componania.... ate). |pSl 

CanoJ'a aacond Jtap waa to taka what waa lafi. dia ralavant informatton. and 
dalaia pana diat ha baNavad laamara would ba abia to llgura om on ihair own 

Procadural dataHa wara daHbaraialy apacWad Incomplataly to ancouraga 
laamara to bacoma mora axploratory. and tharalora. wa hopad. mora hlghiy 
modvoMd and mvolvad in tha laaming aciMty (a.g. iha function ol tha 
curaor aiap4iays waa Introducad wHh an Invitation to '^ry tham id aaa') 
ICarroN. p.6| - 

CarroK'a manual waa tutorial In iha aansa that raadara wara axpactad to try 
tMnga oul aa diay raad about tham. Aftar giving aoma aubjacti tha Minimal manual 
and odiar aubjacu 4ha original manual. CarroN found two ihkiga: first, sublacts whc 
worfcaJ ttwough tha minimal manual laarnad lha basic in(omiatk>n mora quickly, and 
aacond. whan thasa subjacta tvani on to study advfincad tachniquas. thay laarnad 
mora of diaaa tachniquas mora quickly than aubjacts who worked with tha original 
matarlala. 

Carroll admits that this aftod at daslgnlng mkHmaHst matanals was axpioratory 
For aumpla. aa a rasult of praNnHnary tasting, ht found ha had to add In soma 
axplanatory sacilons as wai aa soma procaduraa that sub|acts 'dually couldn't ligura 
out on own Fudharmora. Carroll mada othar changas to tha mtnuai in 
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•ddMon 10 nwt'Jno h shoiiw: tm dwMtd lumlnolooy and org«nU«<t trw 
Jhcuiilon arouml typical t^mtltona for uMct. H It mort'ioro uncortom how mucti ol 
Iho oupoHortiy ol m nUnimoM vonloii It duo lo looQih ond how much to thoat 
odMf chonQot. Hovmvw. m tfio mtin Cml't llndkiot tuppod Iho mMmtltot potttion. 
hMino lott to rood ltd 10 ^qulvtloni or bonor toomlno n • Mtr ovoral t%*j 

Mtldttr Comfi t tmdy nor ourt olowt uo to gootrtim whtihor or not 
olobor a dont ahould bo moludtd m o loxt. Wo hovo no fyotomatic bttit for 
conirotdng dio Idnd ol o»toidono m our monuol lo ihoto m tho ortglnti 
DUploywflMr manual, to wo dont know what wo dM dgM-lo Qot bottar porformanct 
and wdai dw wntart ol Carrol'i olaboraiod vortlon dM wronQ. Furthannora. wc dont 
Itnow oxaedy what our olaboradona dM lo Improvo tubi^ porfir?nanca, to wo can t 
pradtel what Mod ol alaboradona art wor^whMo. THo work 1 wM dotcribt now 
purauoa bodi ol dioao ou at d ont: wha^ typoa ol alaborailona art nocttaary and hcw 
diay aMaci dw utar't bthavtor at tatk. 

2.3. Tlw Effdct ol Elaborationt on SMH Parformin^ 

Tha aubtodt m our OMporimoni who tiudlod iho olaboraiod manua' compitiod tha 
tatkt m lowor tiopo than tub|tctt who taw no olobortUono. Thort ara two major 
waya m wWch dw olaboraHoni mlQM havo holpod aub|acta ptilorm iho ittkt mort 
oMdofidy. FIrtl. olaboradona may havo holpod tubiodt conttnict mort otfldant p^nt 
for aooen^ithinp a tatk. Somo olaboradona m our manual oavo advtea about whon 
to uao thoft<uit <tuch aa wMcard characiara). II diaaa alabortiiona Mpod tublocia 
romombor to uaa I'm thon-cuta at dio approprlaia Nmat. dion tub|octi who rtad iho 
olaboratod manual would bo abia lo comp^ mo tatitt wWt f c ;ar corimandt. Tha 
taoond araa m wMch alaboradona may u halpod la to Qonartta tyntactteaHy 
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corrta compuiar commands Tha alaboraiad manual coniainad many a<»mpta9 of 
tyntacHctHy corrtct commands and dttaiitd txpltnttlona ot what mt notation meant 
Thata alaboratlont may havt htlpad auolactt rtmtmbar iht namts and iht syniax of 
dM oommandt and lormuiata tyntactteaify corract commands mora aasliy ^ 

Wa InvatUgattd diasa aliarnatlvat b* analyzing tha Undt of commands subjects 
latuad a?)d iho Mndt of misitkot i^tay made. TTitst data wart avallatMt froi.i tt\o 
rocordt or *on^% proiocolt' of iht subjacts' kiitractkMis with tht compuitr Tht 
commandt K tha proiocolt wtrt tontd Into ftva cattgorics:' 

* Producilva movat: tyniacHcaNy corract commandt tha* ctrry out a *targtt 
action' or that tntblo ono. 

* Vordlcttlon movts: conrK^ndt inat chock whtthar a praviout command 
had ttio dtskod affact. 

* Exocudon orrors: corrM'nanda that coniabi ono or moro synioctic orrors 

* Qooi tpodftcaflon arrors: wrong command ittuad or fallura to perform a 
proraqultltt action (Tho subjoct may have had soma misconcapiion 
about currant state of tha compjtar or dio capabMHIes of a command ) 

* Racovary moves: commandt to gain Wtlormailon after an error or to undo 
undaskad effactt. 

It la Important to note thai recovery moves aro not simple corrections of syntactic 
orrorti; recovery moves ere efforts et problem toMng to diagnose syniacilc errors 
ftuch aa rearranging the alemantt of die commend Une). as well as e'^orts to figure 



inmpl f ol tyiHtcilcaMy contci commtntfi m«y h«tp in oil>«f wtyt Otw iNuMiMlng tha commtntf 
tynMi. SM«nQ • vftri«iy •i«mp(«t tf«picllne tfltt«faA( •poUctUons ol • comi and might tiso Mtp 
p*opi« HMTfi mcfe « >out lh« funct'«f> ol ih« commtntf or whtA or tn wftM CHCumtttnctt lo «ppty it 
TM« hMMloA ol oiwnplai «ii am oipioMotf in our mtimoi. iiaco mj« commtAds «*•(• iHusirtiod with 
Ml ofi« OMAmplo 



'irt dl. prolocott (or 30 tubfocis «ro«i «A»tyz«d. h«N htd Hudlod iho Eltboioifd voision ol iho 
mvwti and h«N ttio Unol«bOfiiod votMA AN ol Ihi fub|Mts wtrt :n tht AMi condition (lo, nono 
htO h«d otfvtAco knowittftt ol tft« t«sks| 
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out what tMtct • conmfi0 and lo undo any uncMrtd conMquancM (such at 
dilaHnp «M that wtra coptad to tha wrong location). Any syntactically cocract 
command that acMavad a i^oat action waa daaaNiad aa t productlva mova. 
rajaidlaaa of wliaihar It waa praoadad by an Incorract attaira>:. 

Othar faaaaichaia of human<".iipuiar mtar ad iona hava uaad achamaa to analyza 
tfia anm paopla maka wMa patfomtinQ taika on tha computar. for axampta RNay ft 
OUalay <1M4) and Sabrachn. Oahmboa. wagnar. tlack. Dacli and WiMar 
( fotthcommg). Thaaa codkig tytiama dMor in aoma Imponam raapacia; for axampia. 
only our ayttam axammii tha rnadva dlndhutlon of products oo^nsnanda 4nd 
dMarant lypaa of arrora. Hovmmt. ^ Ihiaa ayitama dlNinguMi batwaa n goal aantng 
problama and problama of a wa c mlon. 

TaWa a-t ahowa tha dMbulson of tha Iva lypaa of commanda for aubjacta who 
aaw dia afiboratad manual and iub|acia who taw i< unalaboralad manual Tha 
rw^Mt of aiapo tor producdva and vafMcadon movaa wara aaaan d aMy tha aama for 
tha two groupa. If iha alaboratlona had halpad aub|acta mwam mora affldant aomiton 
■tratigln, «ian wa would hava'axpa^'Md iha alaboratad grou:* lo hava naadnu lawar 
productiwa movaa. But tNa waa not iha < 

Tha %^lfaranoa in bahavtor batwaan Nta two groupa appaara ki tha llnal thraa 
catago aa oommanda. 8ub|acta In Iha Baboratad condMon laauad laaa man haM 
aa many comnv^nda that contalnad ayntactic arrora aa aub|acta In tha Unalaboratad 
condMon. 06)*aJ. P<.06. About Iha aama ratio hald for goal-apacMcation arrora 
;ind raoovafy movaa. but only tt^ ooniraat tor iha raoovary movaa waa algnHlcam. 
<lD«a.3. p<M So two iNnga thai tha alaboraitona a aamad to halp aubjacta do 
wara to laan\ to panaraia corraci oommanda and figura out how to llx bad onaa. 
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TABU 2-1 



Maan Stapa Par Subject lor flva Mnda ot Action^ 
as a Function of Varslon of Hanual 



Slaboratad Hanual Unalaboratad Manual 



Product iva Movaa 
Vtrificatioo Movaa 
Ixacutton Irrors 
Goal Spacif. Brrora 
Eacovary Movaa 



*Contraat ia aignlf leant at tha .05 Irval 



27.7 atapa 
11.0 

9.S 

7.3 
11.3 



33.7 seeps 
12.3 
20.2* 
13. S 
20.8* 
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fltdtr. CiMmty and Moivan (ki pr«M) mis ttwM rttuMt imo • blo8*r pk:ii.iv> ol 
Willi ptopit hm y 10 iMm tfi ordtr ic t iww mm of procoduroo. Nko thoM In • 
oompiMr fuomiil. Wo oon c oM of good iM por' ^«nco ofi • novol utk oi 

t /^ppi o oliin g Pio NMoMno of novoi ooneopio and procoduroo. For 
OMOiiylo, wHol ii 0 tubdkooiory, «M dooo II moon lo copy o fNf 7 

Z Womoiobort n g tio procoduroo and uwdor n andhQ How le oxooulo tftom m 
• opocMo aHuadon. For our look domom. Mo bivoNoo romomborino tho 
•yiMttcMc ruloo and Mlna ttioni lo lonoraio corrod commando. 

1. nomombortno lo uoo iia moot oppi o prtoio procoduro tor ttio okuoaon ot 
hand. Whon mora lo mora mon ono woy lo do «diol you woni« 

QraiNad dial dw protocol anolyolo woo poot Aoo and dial Mo ovidonco lo not 
roMoread by ddnM^Q-aloud protocol dola. dw focuMo of dw' onolyolo ara jM quNo 
ouQQOodvo. Tlia adwamaoo of dw oloboraiad group oaomo lo ba hf itio aocond 
auboon^Mnon*: knoidno how lo lormulaia commando corrocdy. rocognldno what wat 
wrong m tymacilcifty Mcorrad oommanda and Ngurlng out how iha computor 
imarpraipd dia Incorrod commando. 

' Now dia mformaHon m dia manual can ooncom any ol Ihooa tubcompononii: 
mtorm a don abom whal commando «ra avalabia and what may do. mformaHon about 
how 10 loouo corrool commonda and adwioa on whan lo uaa ono oommand radwr 
dian anodiar. am toma of mm ^t^oatmim m dio monuol ooom much moro rolovoni 
dion odMro lo loommg how lo fonnulolo oorrod commonda. ProoumoWy. tho moot 
fHovom oloboradono would ba diooo dial roloia dNcdy lo dio commond noiation and 
dwoa dial gM axamploo of corroci oommandi. d dia only advaniaga of tho 
oWboralad varalon n«a In haMng paopto loom dio commond oymax. than parhapo 
only dia olaboraikino rotovam lo dHa loplo wor? nocoooaiy m dia manual. 
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2.4. Controlling What Typos of Information Receiva Elaboration 

In ordar to tail whathar iha lyniacilc •laborailoni wara ma sourca of iha 
diffaranca m lubjacta' ^rformanca. wa conductad anothar study in which wa 
lyatamaHcally controHad tha avaHabWiy ol iha alaborauont by lypa (again raponad 
mpra fuly m fK^fim, Chamay $ MorQan. m Wa itanad with tha aiaboratad 

manual wo had uaad m tha pravlout axparlmants. Than wa classiliad iha 
alaborailcna in tha manual according to whathar thay concarnad *concap{ual' or 
'aymacdo' Information. Elaboratlona wara datalftad ai 'concaptuai* \t thay 
concomod baalc concapii. auch m ma purpoaa of a command or whan to uia it 
ElaboraOona wara clatalllad M 'tyniacdc' M thay or :arnad h to iMua commands 
corrocOy (o.g. axamplaa of commonda, dataila about notation convan.tons. aic) By 
crooakig diaaa lactori. wa cama up witti lour vartiona of tha manual; ona cont^lnad 
bodi concaptual and lyntacilc alaboratlona, ono coniolnad |uii iha concaptual 
alaboraUona, ona |uti i^ tyntactlc onoi and ona contalnad naithar typo. 

Tha purpota of tha ctasa^flcatlon v/u to Mparaia out Inlormatlon about syntax 
Irom odior typos ol Inlormatlon Two cavaaH ara In ordar. Fkst. although wa hava 
daaaad *luncllonal* Information Mbom tho purpoao of a command togamar with 
'aalacHon' Mormailon about whan to usa a conwrwnd. mis should not nacassarily ba 
lakan u a maoradcaHy iloniflcam groupmg m fact, ma rasaarch to ba dascribad m 
iMa disaarutton wW attampt to sort out tha rolo of salactlon Information. Sacond. wa 
hava daaaad axamplas of syntactically corract commands as syntax alat)orailons As 
noiod abowo. such axamplas may hava oihor banafUa raiaimg to laarnlng tha function 
or opprrprlata application of commonda. To tho axtant that subiacts naad additional' 
alaboraMon for thasa hmctlona, wo would txpact tha 'concoplual* aiaoorailons to 
Improvo parformanca. If tha syntax axamplas also contrlbuta haavily to thasa 
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f MMlm (M oppoMd 10 ttw tymax MwHon im Inv* poMaiMf), thtn wc would 

In INi OMiMrtmofil, htN of our tubloclt Vfora oxpodoneod compulor umto and half 
woro n«4ooo. Wo axpodod tfioio groups lo hovt oomplifMniary ooodt m far ttM 
oonoopiuai oiabQfaiiofla waro oomamotf. CMpaikACOtf oompufoc uaors a^oady 
undafHind ifto p^naial oonoapia batilnd ooMpuMr i^yatoma* Tlioy naod lo know wtiat 
0010110 Ofo ovaNotolo oo a now ayaiaaiii but Hwy nlQfil bo dMrodod and borod by 
afabofHlono on oonoopio Niay oboody undamond. Movlooo howavaf lack a door 
ffwiroBdn n ol whoi a ooMttdor oooiadna auMoai eon do Wo oxDOdod Itiont lo 
banoMl Ironi fuMor oipionodona* On dto oilior Imndt wo oj^nciod axpartancod 
CMmoar imoto and mmImo iiko tti hMitt Inmr ^AiiflrailaM on ttia conmiond 
ayniox. Cxportoncod compuiar uaoct ara probably bodor oi parsbiQ dio abairoot 
aymocdo nilpa ihoi aro found bi moot compuiar monuola, but boNi axporloncod 
mmnioaf iMora and novlcoB tan bontf al lomiuladno oorrad conwianda 

PMMiooft^aa If tttoy novo ooan oxoniplaa of corrod oonMnonda* 8o bdb proupa of 

oamnionda* 

Nni mrarlilnaltf wo iound dial dio oaoorioiKod »*M M fi i it M f umti Doifnfinod much 
booor dian iho novlcoo on oMiy mooauro* Howovor» wo dldn*l find dial axparts and 
novlooa noodod aloborodona on difforoni lypoa of Mormotlon. tnataod, both proupa 
bonoMod Ironi dio o/max olaborailanK Whan dw ayfdax oioborailono wora avaNablo. 
iub|oota worliad atpnMcani^ moro md cl i^ and laouod alonMcanily fowar cooMnanda 
dtan wfian may wora obaant. in no cooo dM bio concopluol olaboratkNia aaom to 
hava any affaci vdiaiioovar. 
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Tr»aaa roauiti provkia itrlking avkitnco ihat utora bonotli from axtra infcmation on 
how to axacuta procaduraa. boih fjxporlancad and novica computar uatra parformad 
h (tor with auch oloboratk>na than wUhout tham Tho finding thai tha coficaptual 
aaboraUona wara uaalaaa avan for tho novica computar uaari wai a bit iurprliing. 
HowvMr, a aaoma pramoiura to conckido thf> wo novar naad to alabofita on 
concopmal information in kiatrucUonal toxta. 

2.4.1. Tho ImpMcatloni of tha RoauNa 

My pool In ihla dlaaartatkm la to conaldcr fudhor ttw quaiUon of tha concaptual 
olaboratlona, In portlcular thoao that cor^n 'aaloctkin* inlormatlon: whan to uaa 
pordculor commando or how u> chooao botwoon almKar commands Thara ara sovoral 
pooalWa axplanatk>na for why alaboratlona on aalactlon la^ormailon fattad to improvo 
porformanco whNo ayntai alaboraUona auccoodod.^ Lat'a conaklar thraa plauilbia 
axplonadona. Flritr H la poaalblo that both typoa of olaboratlona raaNy ara uaaM. 
but dW aoloctkm information happanad to bo Irrolovant to tho particular laikt in this 
axporbnoM (I. a., dodding among the plaualblo commanda for aach task may hava 
boon irMody ilmplo or tho tolocilon of ono crMnman^ ovor anothar may not havo 
draadcaNy knprovod or fcnpairul affldancy). H ao. than N ahould ba aaay to ahow that 
alaborailona on aoloctkm ktformatkNi bnprovo pailormanca whana"::r laakt raquira* 
carafid cholcoa amonp commanda. 

A aacond axplanatk>n shifta tha biama from tha laaka to tha 'tiaborationa 
thomaalvoa. Suppoao lhat tha tolactk>n ktformatk>n raaUy waa ratavant to p^x'cl 
porformanco on ihaao laaka (la., tha choica batwaan commanda waa hard or wouM 



wowmaAlt MA b« dtv*lop*0 to* 'luActton«i' lAformtllpA u w«a 
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hM tmcHJ •MdMcyl. tout M^ltcit couWnl ftQurt out how to ial« advinito* of 
MoMomnion and tfw ptrHoulir Hbor a ion o In Nm nwmit) htpponod not to bo mo 
mon oNoctfvo Una. Ao o roouft, oub|ocio foM to moko good uoo of tho soloctlon 
Inlowmiow. wDoiior ololMraftoni toon avoioMo or not. Ho«0¥or. N tlio manual had 
oomalnod hoHor oiaboradona. iwn auh|ocia would havo boon abia to oxplon tho 
aaiaonn awoniiaaon ana aiav parioniianoa wowo nam anpravao. vi hot cmv. ui* 
irtdi la 10 And dio dght Mnd of aiatooiadon 

Tho iwrd Md moac Naraadng poaafcty la thai «io roauia of iMa amdy ahouM 
ba taban ai Imo mIm^ aiara mtf be dMaram lypaa of MonnoHon* only aomo of 
wfileh naad a rt a f iaM aiaboradan in bwmicMonal wanuali mtomwlon about how to 
oanaiaia aymacdoaly ooiraoi ooMpmof ooMaModa wauM dian aaam lo ba i lypo thai 
banaMa troai a4aboradoii» but aalacdan bdonaadoA la not* In Ma caao. wo aiHNAI 
navar And tMprovamani far aub|aoia vdto road aalacdon aiaboradona« no matiaf wtwi 
dw aiaboradona took aka. owan whan tfw a i< )adwoni a i isaka mQiJk9 caraful aoioctlon 



Nodoa dial diaaa mplwdena poad dvaa laaiuraa lo conbol whaihar alaboratlona 
hava • ohanca lo Improwa partowwoB'^: dio laaka nwai ba onaa lor wMch tho 
kdarmadon ratowant dio tfabafadona muai bo dw rtghi Mnd and dM MormaikMi 
muai bo a iypo dwi banadia trodi alaboradon. Each OMplanddon aaaumaa dtat a 
ddlafam ona of diaaa dvaa faaddoa waa ndialno for dia aalacdon bdormatlon in our 
aapafbiiant« d la kd a r aadnp and knponani lo dnd out wMch oxplanadon la corrod 
bocduaa diay hava ddlarani knpAcadona lor wrdinQ affacdvo manuala' It aaama 
Iniyldva^ obvloua that wrdara oM aCwaya tiava to comldor dia taaka ihoir raadara wtd 
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p^rtorm and that may mutt alwaya choota ataboraliona carafuKy^ Howtv«r. if ma 
mird axplanatton la corract. than thara ia an addltkKial faatura. information typa. mat 
may halp wrHara dackta whathar or not to alaborata loma point in a manual 

Lat'a bagk) by toitowkio out ma knpHcaUona of tha drat and tacond axplanatlona 
SUkHwaa mat loir any glvan land of informaUon. wa can alv<aya find a tafk for which 
p«rformanca la knprovad whan ma right aiaboradona ara avaHabla Than, m ordar to 
dadda whamar or not to alaborata a point, wrti^ flavor naad to conaidar what kind 
of mibrmadon mo pokit la. but only mo ratatlva abundanca of taaka for which that 
kdormadon la ralavant. For oxampla. auppoao mat mora ara taaka on tha IBM-PC 
for wMch aolocdng mo moat approprtata command la <^KHiit and making tha right 
choico oroatty knprovaa ma afftoiancy of tt.a aokjHon If maaa 'aaloctk}n-cr»lcar 
laaka or aduadona ara fakty common, mon aalactkM kdormaikm ahoukJ ba mcludad in 
ma manual :c ;ialp. ma compuiar urar pkA ma bast command. On tha othar hand, 
maaa aduaikMM Might ba ralatlvaly rara. That la. tha taaka wa chosa for our 
axparimont may hava baan highly rapraaantailva of tha taaka moat paopia parlorm on 
ma ISM'PC moat of ma tkna. Than it might ba aafa lo emit tha aalactlon 
aiaboradona and k>ckida only aymai alaboratlona. at wa did in ona of our manuala 
In abort, if wa can aaauma that any typa of Informailon can banafit from aiaboraiion. 
ttian wrdara only nood to worry about ma dtatrlbutlon of taaka for whk:h th4 
kdormadon la ralavant and Hndkig tho right alaboratlona.* 



*HeMind. Mom. Oma a Ooiy (iia$) p«o«M« »om* •■ptfimwuM tykMACt mm vvvn loi m* -fynus- 
lyp« ol MormMlon <!•• h«w lo •■•etiM • pfOC<1ui«). MM l«tf«t ol spMiftciUon mcM f cai«luMv 
citoMfi: 100 lkt« • 49V— of dot*! ortly conMti mm iMrnof. 

*Undor ttM •MkfUi*. tho ro«ton vifiy fynMs •(•^maltont V m hotplul It no mttloi wtiM task 
you f**f wi«h M uM A wamtAd tat. fCii <km iimyi AMd ta iPMu ticxf tc Qtntitxt the coinmtnii ifno 
oorrocay. 
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^f-' On MM pUmt iiMid. » «w NiM •xplMMlon to oorrtd. m$n H'% not tuffictom to 

eonMr ftm tatkt aod Hit qutMy ot ttoborMtofta. Wm«rt muM ttoo conitd*r 

^ : . ■ M iyp9 of MofinMloii. II wouW b« vtry NIpM lo know m wMnct mtt tyntax 

MoniHMloii to a typo M bwioiit Irom otobomHon but M •• Hct ion Mormttlon it a 
typo M tfooMil. Thon wrim iwod novor wony aboui MndbiQ pood olaborr^ for 
nnciott MomwNon: ttwy cm oNwyo totvo MtocHon Momwiton unotoboratod no 
iMMar MUM «w laaka ara tto. TImto migM atoo bo otfior lypoa of Mormation mat 
do not bontil mm otobomNon. 80. N two to roooon lo boiovo ttiai itto third 
oipltnMloo to cofrad. than our waaawH Mraiogy should bo to oxplain why syntax 
mtenwadon dNIora Irom iHicdon Infar m ado n in Ma mapoci oiMf aMampi to pradlct 
wlMl otfior lypoo of I nionwaitoo «« bonoM or nm fc^jm otaboradan. 

Tho raaaarch mpoitod in dw WMng ebopiara a d o m pia 10 aort out thaao 
amwididi «y crood n g oondMona undar wMdi poopio oro moro or laaa Ikaiy to na^l 
imcipn inlormodon and provkMo dMaram lypoa of nU c d on oiaboratlona. Tho 
oj^artmom to doacitood in dalal in Ctiapiar 4. nrsi. hoivovor. Ctiapiar 3 analyzaa 
wnai to iiMolvod in iaia cd n p a proootiuro and nMm ratolod roaoardi. 
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Chapter 3 

THE ROLE OF SELECTION INFORMATION 
IN SKILL LEARNING 

TNt dmnrtiMon locuM on M ol tfw «VM m^Umpoimm d tktt iMmino 
p t tttnud m CiMpior 2: how poopit loom lo ehoooo opproprMo procorturoo lor 
toMno % proOlom. TMo chopior bogini by um oldortng Pw proWom ol oroeoduro 
iilicilon and wtitt Umlt ol laHv roquiro tiraiooloo for ii t i c ii n g o procoduro. I wM 
than ooM&ior wImc miofimPoii to on tatmicionol M mlOM bo folovom for loorntoQ 
luoh uroiogfii ond brio% rovlow wboi woitc two boon dOM to Mo arot. Tho 
oooond ptfi ol Mo cboptor dooio wMi wtioi tonnicdon on Mtodion ihould look Nfco. 
loouttog In porHeulor on Pw rolo ol OKomploo. TDo dwplor condudoo by provlowtog 
boor Pw oxportmom lo bo roportod • w owpiod to mompwlt n Pw foomroo ol took and 
quilly ol olaborailont Pwi «yoio daocrftod at Pio and ol CbapMr 2. 

3.1. Splgctton Information and Talk CtiaractarMcs 

Tbo ajtportmtou ol flodtr. Cbamoy and Morpan (to praaa) and CarroP (1905) 
both ooneom ihMa to poopit loom a ioi ol loooaly connoaad. unordarad 
piocoduroo PMl can bo combinod lo acMavo a wido vailoty ol in iWa 

ffoopod. loamino lo uao a ooncpmor oporoPnp aytlom or a compmar taxi adHor la.^ 
•IniNar lo laamtog how lo oook. A pood cook knowa how to uao aoma baiic 
procoduroo. such aa m naalno vagacoblaa or maktop a whNa aauco. lo prapara ■ 
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wkM vanaiy oi dishas SimiUfty lha commandi in a lypwaf tan adUor can oa 
comwnad lo saiva gcait at divarsa at wnling compuiar (. ogftms ^uung poatry 
dokiQ data •niry. and so on Juil at somaona who it sKMiid m cookino can 
combkio lha batk: lachnlquat lo acWava naw cuikwry daMghit wlihoui depending on 
a radpo. to a partoo tkUlad In ut^g a compuiar muti ta ajla to salad and 
eombtoo appropriaia procadurat to achlava hit or har own 

Tha wWa range ol pottlMa goala for usktg a compuiar tytiam (or learning soma 
comparabia tkUl) hat a profound knpad on the coniani of iha typical Insiructlonal 
text. It would ba diJfteoH H not knpottiWa to axplteHly addraat aU the goait a uter 
ffltghl adopt. Contaquemiy. moti compuiar manuala detcrtbe the commends and 
proooduroa to the abtiract. to that uaart can apply tham to whatever goalt they may 
have adopiaci at the moment. Una common c$uH la that naw learnert develop 
'functkmal ftxadnett*; they aatodate a command w«h whatever purpote »hey first 
uaad a lor and forget that the command may have other valuable utet Another 
common -etult It that p<K>pla nmah readkog a detcrtplton of a command without 
havtoo the aHghtett due at to whan they'd ever want to use It Even when there 
are examplet of how to uta the command or procedure, at bett the exempia raHActt 
a Quota about what the mott typical uta might be. and at wortt the exemple itteil 
la arbitrary or formal. For example, to the IBM matiual for the Disk Opereting System 
(Anonymout. 1964).' lha commami for ranamtog a We la ikuslrated with the fottowing 
exampla: 'The command: RENAME B AOOOE HOME renamat the file ABODE on drive 
B to HOME/ Computer manuala are not the only totimcttonel textt to present 
arbitrary or generk; eximplet. of oourte. The problemt that ttudentt work on in 
math dattet or even writing clattat olien bear Httia retemWance to the real world 
problemt that they wW need these tkWs to sdva 
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SMI iMfim. ihtn. fflty nMd iMlp oomt«:llng IndMdual procwIurM to Moh«r 
onlir goA lo hilp thwn rMMmbtr thtl iwr« to a rttowM or •ppropdat* command 
^9t M 0m mMkon. Thiy atoo na«l 10 know how MMdual proctduroa ftlata lo 
•aoh otfiar. ao mai <*t»o« prooadurot ara aWhr. Ihty can chooao ih# moat 
•ppiopilalo oiM for ma 9Mn drcumaiancaa. I uao ««• larm aatodton intormmion 
lor Mormaalon m an matructlontf laxt M alma ai aatfafyCno aMior of ttioM noMla. 
Tha quaaion to. to «hal oxianl ahouM a a toc Mo n Inlofinatfon bo otoboratad M ma 
ton? Vm ttvarimoma tfaaorftod m iho prv^loua ctiaptor auQQoalod auch imormatton 
can IM comoyod IMto or no atoboraiton. Ono Qoal of tfw dtoaanadon to to tatt 
iM QOfloraliy of M roault 

M to worm noMng mm aatocion m^grmaion to probab^ not nocaaawy lor oihor 
iMa of aldi toammo. audi aa toomino lo aaaomWo a dovloa or oparaio a pioco of 
•QU^mam. , Wharaoa tfw procodurao m a eompuior manual can bo uiad lor • 
vaitoir of Qoato. tfio goal of an oaaombiy loafc or an oporadona laak to (akty Ibtad. 
in an aaaambly laaiu audi aa toamino lo put aogotfiar • aiaioo ayaiam. dioro to • 
ipooMo Mng that iha ptocaa ara going lo fomt m an oparadona toak. audi aa 
toaming lo oporaio a radio aal. diaro may bo aovoral dfforom oporadng procoduraa 
10 torn, or ono gonord procoduro wMi braneftaa for Mrtoua eondngandoa. but aadi 
procoduro for dw mod pan baa o dtodnd god. Bocauaa dio gooto arc mora 
ddMlo. «o daacripdona d dio procoduraa can atoo bo moro apocMc. In' aomo 
caaao, dw dapa or procoduroo may bo prWamad in a Hiad ordar diat mud bo 
fdtowod axacdy. H tha procoduroo ara aufftotondy comptox ond ddoltod. loamara 
fflIgM navar axpoci to wcrk mdapandandy of ttio todrucdona. aucb oa pNou wbo 
rtvtow primod diock-itota aacb dma may dy. m comrad. onco laamara know how to 
uaa « computar taxs stStoi. they ufo tha mamid mdrriy io toam now latturaa or to 
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•olvo aoma unaxptcttd pfowam or lor an o^cinonai famindar For mesa reason*, 
tha aWtoy to Mtoct an approprida 5K0cadu.a lor iha talk at hand is mucr, lass 
Important m aaaamdy or opwatlona tad« than in toamkig a lyitam of 'muiti- 
purpoaa* procadorai. Tha Inatfucitond matartato lor awambly and oparation tasks 
probably don't noad sdactk)n inkHmatkm.' 

Tho work that to rdtvanl to adactton inlormaUon hat thua f*' baan sparsa. 
Tharo to aoma aartv avWanca from Smadduod (190$) that without any instruction, 
ptopio can davdop conatoiont and amdant airatagtoa u thay work through a sartoa 
d probtoma. Not aurprtdngly, Smaddund found graai knlMdual diHarancai »n tha 
qudlty d tha dratagtoa. Olhor dudtoa auggad that you c«n tram paopia to uia tha 
atfiiocy you warn th^ to uac (a.g.. Radar, in praaa: Starnbojg & Katron. 1M2). in 
ttiaao dudloa. iha taak Inatructlona Idd tha aub|acta whteh airatagy to uia. dthar iot 
ttio whoto axparlmant or lor aach indMdud probtom. Tha dtuaiton I want to look at 
har- to a bit dWarant. What Cm imarattad m to a<^«:a that talis paopia 'Usa 
procodura x only whan you ara in aHuadoni that hava auch-and iuch charactariitici. 
ottwrwtoa uaa procadura y.* Tha guaaUon to. whan paopto saa such advica and 
ttian ara praaanlad with a ranga of dWaram aMuatlona. con thay ptek out tha onai 
with tha right charactartottoa and wia thay uaa tha advtoad procadura? 

Thto kind of advico to obvloudy vary taak-dapandont; advica to much mora ilmltad 
than tha ganard pfObtom aoMno hauridica thd Pdya (1957) or Nawail and Simon 
(1972) wara intaraitad »r.. Advica to much mora ctoialy rtiatad to tha seleclton rulas 



'Wwa (laai) tod SmMh a Oootfmtn (1163) p»ovk»« iMmftiU ip«i»ffl«ni« •vid««c« ihfti 

liittiwcaoA*! t*Klt loi Artd op«4acfl t*U» CO U$nttU. ttom a d'Jtttm typa cf motmtiton 

•hew il wofkf lAloim»IIOfl lOtM •tttrtit *Mi kAowWia »»* P«'» • '^•'P* * 
(fwn«f pfoc*duf«« fof how to put M tog««h«f of oQVttm M 
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from Card. Mc«tn snd N«w«l't (1M3) moM of iMk p«rfomHmc«. Card. Moran and 
Ntwal amdM •jcpartaocad uMra ol a oompirtar laxt-fdNor mat olfarad two baaic 
maihods ol movlno ma curaor laarcNito for a apadflad Mrtno of cnaractara or 
mo^ Hia curaor up or dowin a Ina af a fSm, Thay found ifiet iha usara had 
Id anHW a bia aalaction rular ^or diooaino f'xmmn tfiaua mafho^ (a.g.. uaa tha aaardi 
maihod H iha larga^ tocadon It moft Itian Nvaa Inaa away, uaa tha Ina^laad mamod 
odwndat). Pftaumabfy. ihaaa oompmar uaara da^alopad ihalr atrataglaa thamaafvaa. 
but «halr aarfy laamlnQ waa not obaarvad. A! laan aoma paopta had davalopad lainy 
malfkHM airaiaolaa. for axampia. om iub|acl fiavar uaad iha atrtog aaarcfi maihod: 
aha uaad aoma varlaHon of Iha Inafaad maihod avan «^ iha targaf locatloh waa 
ovar 10 Inaa away. . Card. Moran and MawaM tuccaaafuly modaMad how iha axpartt 
uaad a ala cdon rulaa. but thay warani miaraaiad In Iha raladva affldancy of tha ni^ 
Ihalr aub)acia had coma up wMh nar In how iha aub|acta had acqulrad Ihak rulaa. 

'Thaaa laauaa ara impoitani for laacMng no^caa lo daal whh a naw aat of 
procaduraa. H novicaa doni appradaia whan lo uaa vartoua procadurta. thay mighf 
oompfaiafy ovarlook procaduraa ihal would ba vaiy uaaful lo iham. Inttaad. ihay may 
aafda on aoma mafndam procadura ihai ihay happanad to laam firat or that may ba 
aaay lo ramambar. Evan aaaumino that paopla do know about attarnaitva 
prooaduraa. iha dadaion o* ich ona lo uaa mioht dapand on a partonaJ prafarmco 
for aoivino probiami a carialn way. or II mlohi dapand on iha ipacMc faaturaa iha 
problam <ta.. parhapa paopfa can aaaNy guata or flgura out that ona r^hod ta 
baiiar for a glvan problam). Tha goal of thU raaaarch la to find out whathar tha 
dacMofwnaMng procaaa can ba biMuancad by advica In Iha manual on whan to uaa 
a apacMc procadura. So tha work tfwt wM ba daacflbad hara ^uym two aorta of 
raaaarch quaatlona: 
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1. WW paopla follow advica about whan lo usa a command? When may 
don'l. It It simply btcausa Iha task situation (tsalf makes M easy lo 
idanUfy th« most amciant stratagy? 

2. What lorm should iha advica taka to hava iha most effaci? In particular, 
ahould advica ba 3tatad fusi • varbai ruia or should It ba aiaborated 
with axamplaa? 

3.2. Wf)at It Takaa to Follow Advica 

Aa daacrlbad abova. tha son ol advica that wW ba siudlad hara is assanitaily a 
rula of tha form: *Uta procadura x only whan you ara k\ situations that hava such- 
and auch charactarlatlca. oiharwisa uaa procadura y/ Tha advica is intandad to 
gulda a chdca batwaan two or mora procaduraa that can t>a uaad to solva soma 
problam; tha advica po.ita to tha aaalast or moat afflclant procadura for tha 
drcumatancaa. 

In ordar to loMow advica. laarnars must do tha lottowlng things 

1. flamambar tha advica 

2. Ba moilvatad to loHow iha advica 

3. Dadda whathar or not tha task situation matchaa tha conditions sp^cUlad 
In tha advica 

4. Carry out tha racommandad procadura. 

Tna fkat raqulramant la stralghilonward; isarnars can't foUow advica il thay don'l 
r»riiambar H. Tha form of tha advica and tha dagraa to which it ic aiaboratad. may 
affad how waN it la ramambarad. as wiH ba discussao «fow 

Tha aacond raqukamant la ba&ad on tha fact thai, although advica is a rula. 
compHanca with tha rula la dlacratlonaiy raihar than compulsoiy Paopla don't hava 
to follow advica In ordar to do thair work, tha worst tha. "n happan if thay don't Is 
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• drop In •Mdtncy. in oomrati, tymtetlc nUm for wrMno corrod computor 
oommondo oro oompultory In ttw mtm im H % porton wlohoo lo leou* Q command. 
Iw or it^ muii lolow iho nito Mcdy. In roohMMW aliiiitloni, iMmtn miy bo 
•trongly moiMMod lo wwfc oMdonMy. poftwpo ki ordor lo moot • doadHno or 
eonoorvo roooureoo. m llio prooo nt fo a ao rch . dw nomrt ol dw look provldta a 
dNforoM Mnd o< moUvniion: drt IMk It lo dnd ttit moot oMdom woy to aolvo a 
proWom. TMa iMk foroot iiib|tet lo oomidor wMtouo aoMlont lo • proMom and 
compor* how many aiopo oadi ono would lato. Thooo eompwloono wW bo dNflcuN N 
dioro if» mony poaaM aoludonp. aaoli wIT) o lalrDf Ivgo numbor ol oiopa. m thai 
COOP, subfoda miQhi bP mora prono lo lAMt dio ocMeo lo poim lo dw moat olfldom 
noludon* rodiar dion iiylno lo porform ol dio noooaawy coloulodono* 

Tho ddrd roqidramon] a Jdriaaii dw lad dwi aubjoda mud onalyio dio aduadon 
In 0 problom lo doddo wtidbor dio advlca a pplii. in tod. dw mMcp racommondo 
two ddfoftm acdona dapandtng on did charadorUdco oi dio iduodon. Procoduo x la 
10 bo uood d dioro It s poadlwo mdoh balwoon dio co ndWono In dio odvico and dio 
took tdutdon. k* .4ioro la no moidi, dion MoaAiQ dio «Mco moana uaing 
praooduro y. Aocal. lor oxomplo. dm a ala cd o n ndoo for moirlng dio oiraor from 
Cord. Moron and fkwoN omn Tho Soorch «v«**!iod woo uood d dio largot locadon 
woo moro dwn dvao Mnoa » *'om dio currad locodon. odiorwiao dio Uno^ood 
modMd vao uood. m ordar lo uao proooduro y. loomoro hovo H» rocognteo dio 
oboonoo of dio oonddon o undor whidi dioy would uoo procoduro x (I.O.. rocognbo 
dMi dio ouTMr lo not moro dion dvoo tkm oway). 8udi 'pooMvo' ond 'nogatlvo' 
moiohoo moy affod how ooiy II la lo doddo wMch procoduro lo dv». odvlaad ona. 

r» ' 4y, onco M door iddcfi procoduro lo atMood for dio currom aNuadon. dio 
loomort mud know how lo carry II mi, wMdi dioy loom from procedural Inlormadon 
audi aa ayniax rulaa or yap^-dop Indnjcdono. 



3.3. Finding tha Most Etfectlva Form of Advlca: tho role of examples 

A placo of advlca la a rui«. It polnla out lomaihlng to do (or not to do) m a 
particular ahuatlon. Pravloua raaaarch haa found diat axamptai haip paopia <oarn lo 
apply ruloa m bodi tha prodam-aolvtno and concopi-laamino domaint Tha praaant 
roooarch axamlnaa tha rdo of axamplta for laamino to follow advlca la advlca mora 
momorablo or aatlar to apply corracdy If H la alaboratad with axampiai? Afa paopia 
mora wMng to follow advlca diat la elaborated with axamplaa? if axampiai do 
bonodi learning, what la d about die examplea that cauaea tha effact? ii ii ihat 
examploa provide 9pacdlc, concrete Inaundatlona of die oeneral tarma in the ru^i? 
Or la d dial eumplea provide a model of die tr>«k aubleda have to perform? 

TMa aecdon wW rflelly review previoua reaeerch on fxamplei. it wiM aiio 
deecribe two typea of axamplaa and die ddfarani ededa they may have for iearnlng 
to foNow advice. 

3.3.1. The Benefit of Examplea for Concept and SkW Learning 

Numeroue raaearchera have found diet examplea help paople laarn concapta 
Tlio baalc dndlng la that aludylng a deflnldon (In eaaence. a rule for category 
momberaMp) along wKh aumplea of daaa membera. greedy improvaa a iaarner'a 
abddy to correcdy IdenUfy membera of die daaa. aa compared to learnera who atudy 
die dedddon wHhout examplea.' PoNchft (t97S) defined varloua piychofogicai 
*defenae mechanlama/ with or without eumplea of what lomeona ml^.*** do wNie 
exNbHmg diet dafenae mechaniant. Subjecta who aludled dafinliiona with axamplei 
wera much better at ct^aaifylnij deacrtpilona of Uhavlor paiierna Nlitch (1977) 



*IA iplrN. M» wofh (oNowt • toi>g Mttfmon at •Quaiinfi iinowMdgt of • coActpl iikt i»n\fi witn mt 
•bCty 10 TMOQAlsi lnftti.et$ of tut Itmpt in m worM 
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oMiln«d UnMar rMuHt «»)itn tuNMit iMfiwd nov«l. unftmMv concepts Htr 
Mblicit «m Otoo iMtttr m Mtntfytng novtl cattgofy mtixttMri N m«y rwd M«n 

CMiiViit oMm pnmm typical MtMncM. but Im typical irMncM Dmo 
toiMtf uMlul for iMmmo tfw wtg* and vwlMioii of • coitQonf or Mt Nlitch (1077) 
tm MbMi *Mmotf oonoopM boaor f*m tfio OMtnplM woro dWaront from 
aaoh 0»m Wmn «ltoA ttay waro an laMy aMor. CouMoraxamplaa hava alao baan 
feuad 10 hatp laamara m bowMary oondHiaoa lo a niia or oanaraiiaiion (Tannyaon, 
1173: Taiwyooii. WOoiay t Uantt. 1t72>. Tannyaon. WoOlay I MarrtM look ttiraa 
laaiurM ol •samplao Mo accouM dha typlcaily of ttia aMamplaa. tfw dagraa of 
akalMtiy ba i waa n aMparflclal faaur^^ of axamplaa and tfw aMartiy of txampiaa 
and ooufiiar«»an^) lo Mccaaafdly pradtel haw tfia wrono aUx of axamplaa laada lo 
ovaroanaralailon« undafjanar^aHan and wHoon c apdo n . bi addWon lo tfta cfwloa 
of oMiivlaa. raMarcfiara hava found thai ma ordar of dw axamplaa la hnportam: 
aublaoia laam badar wban typical axamplaa ara praaan t ad bafora mora axodc onaa 
(tato I Andaraon. IM4: Tannyaoo, Siava t Boutwai. 1976). A mora ttwroi^ ravfaw 
ol dw Maraiura on axamplaa can ba found m Mandl. Schnotz and Targan <1964) 

bi addklon to aldbio oonoapi laamlng. axamplot hava alao baan found to facNHata 
probtam loMna P«PP«r (tMD ^Mhd dia affad of ddfarant oompuiar programmmo 
lasibooba on aludanta* abidiy to do programming proMama. Ha found ibat ttudanta 
idio fdod a cartfudy wrMan ciapfar dial Indudad numaroua axamplaa ratad It mora 
Mghly tfian oomparabla cbaptara diat did not contain axamplaa. Mora ImportanUy. 



*Tii« mtw^w d m% mm— ay PoacMk oa^D ana nmcii oarr) bMM wi arsnirwd't oarii 
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thasa atudanta also soivad mora prograftifning proDlania corraclt^, man studenis who 
raad tba olhar chaptars 

Roaa (1964) lound ihai auparflclal tkmlariUaa batwaan iha proOlam that subjacia 
ara currantly working on and axamplaa Uiay pravloualy aaw k) tha inaiructlcnal 
matadala can Influanca thak chdca ol procadura. For axampla. aub)acia laarnad a 
pair of procaduraa for using r computar taxt adHor. In Uva iniiructlonal matarlais, 
ona procadura waa tNuauatad In a task invoMng a shopping list Tha axampla for 
Iha odiar procadura kivolvad a couraa Kstlng Whan subjacta aubaaquanffy ¥)rorkad on 
adNIng a shopping Nat, may tandad to usa ma procadura thay had saan associaiad 
wWi a ahopplng Hst, avan though aUhar procadura would hava worfcad aquaily wall 
This affact of 'rammdmg' haa poianUally advarsa eonsaquancaa- m aubsaquant 
atudlaa. Roaa found that sub|acta tandad to usa tha procadura may wara ramlndad 
of. avan N It was kwpprop^ta for tha problam at hand. 

3.3.2. How Examplaa Aid Laamlng 

Hot>ba (1979) notaa that an axampla Involvaa a ralatlonahtp balwaan two 
alatamanta: a rula (or ganaraKzsilon) and a spacMlc Instanca for which tha ruia la 
trua Hobba daNnaa an axampla as a siatamant that aaaaria tha sama propo Ulon 
as tha rula, axcapt that ona or mora ganaral tarma In tha rula ara rapiacad by 
apadflc tarma dascrtblng dass mambars. Drawing dia Idanthy ralaikmahip batwaan 
dia propoaltlona may ba an assantlal part of racognlxing that a aiatanant Is an 
axampla. In an unpubMshad aiudy (Charnay. 1963). aublacta raad saniancaa and 
aaasHlad tham as aithar axamplaa or datalb. If tha saniancaa wara raad in tha 
oontaxt of approprlaia ganaraltzatlons. tha axamploa wara dasslflact corracth 79% of 
tha tima. But raad In laolatlon. without iha oontaxt of tha ganaralizailons. iha 
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Mr X w«r« MIMIngiMwM from tfw dtiaii: onir 9f% i««rt correctly ctottlflMl 
M ^..Mi^.^^ mMTMlkioly. M •Mffw itwi fMino M •lamplf it not miigh: iht 
ciownogiii Mmm Hw •MM^ and tit nito mute te tipidi m ordar lor tht 
10 tMl» iMTfwt i^piy tfw n4t. f%oM intf AndMon (19M) iiucM sub|«ct« 
iMiIno 10 Mtto fMurUM IMioiono hi tfM p fog io wmInQ fonouagt USP. SMing 
•Miw^Ko ol fMunlv* <Mc«ono Hotpod tuMocio wild toicdono vitioii iht oxwnpiM 
worn praiMiM wMi 0 fi4o M p«t of a dtocuoHoii of how lo wfHo tucti hmcilont. 
am ilw atoM onmploo hod no offoci on pwfonntnco prooofNod pwi of o 
dNCMtolon of !ww roavUvd IimcIIom worti 0.o. iractno dvougli «w vwtatolo Wndbigt 

Md fuHCdOO CONt). 

Qlv«ii MO foUitonhip botMOOfi oonoral niloo and Moncoo. Itioro tdom to bo M 
looM fte w«yt m wMoh orM^ <nlgM lio(p poopio lo«n ooncopit or tolvo 
pfoMooio. ^tudykiQ oxomploo mty: 

1. knprov* momory for dw oridcol fooiuroo of llio ndo; 

2. Cltrlfy omr«* Mn** hi dto ndo by Muoiraihio dw ronoo and variailon of 
daii fiMfflborai 

1 ComhiM loamart of dw uNhy or irudi of dw ndo; 

4. Rroddd a boala lor anatooy lo now probloma 

ttimapm mty hnproM momoiy lor dw crtdoal foamroo in two waya. Fhtt. aa 
auQoadHJ abovo. co wpraiidndhio oxampla aa an ixampla may kmtm roboarahio 
dia raiddonafifpi b otwao n dw oridcal aSomanta of dw ndo. Tho apocdte larma of ibo 
•MiM* «d mat'^idd onto dw ganarai tornia of dw ndo. To aoo bow mia wwita. 
conUddr did loiowhia Qonor aHa don and two alaboradona (itfcon from Chamoy. 1M3): 

*^Tii« dMtfwiM to $ »ti v mim om i* aw tM«Mf cMtw mm ^ m tu t f«r m«i «m p«ic«m oi 
mm$m «M »wf dMMM ewvMOy. M-M. 9<At. mO 1^ #. dw maiMrt tW^y w dMct ii« 
•iMiiaiM tidfwi iw *M(M* •! aw mm$, K4«*io. 9<.ot. 
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t *LawtuH9 art now pancttog wbicri taah lo tuM nandgun minuitciurars 
and dituibutori uaoia for tha damaga cautad by thair products * 

2 *Tha famNy of Jamai RkKdan. a Chicago poMca v:ficar KiUad by a 
handgun, la suing Walthar. iha Waat Carman makar of tha gun and 
Intarnallonai Armamant Corporation. Ha Amarican distributor * 

' 3. *Tho caaaa ara baaad on an unconvamional and as yai unptovn 
applcadon of tha product laMllcy law. tha law mada famous by tha suits 
agahiat tha Corvair and Phdo auiomobllaa * 

To racognlza that santanca (2) la an axampla of tha ganarallzation In (t). but that 
aantanca (3) la not. raadara ndghi hava to raaMza that (t) and (3) stata tha sama 
propoaidon. by matchhig tha Rkwdan famHy to ttia biMatcrs of a lawsuit (l.a.. tha 
agama of a suhig acdon). matching Wahhar to dia manufacturars and tha tAC to tha 
dtolflbulora (dia objacts of dta auhig action) and matchhig dia daath of tha olflcar to 
dia damaga causad by tha handjun (dia raaaon for tha auH) Racognixing axampias 
may diarafora provtda rahaarsal of dw crMcal raladonshlpa batv^aan tha argumanta in 
dia culo aa wad aa ancodhig varlabWty. bom of wMch might knprova racalt 
Furdtarmora. dta axtra spaclflcNy. concratanaaa and famNlarHy of dia tarms m tha 
anampla may aid facad. skica concraia and apactflc tarms ara ganaraiiy racaHad 
battar dian abstract larms (a g. PaMo. YuMa I Madlgan. 1960). 

Evan d k ^nars ramambar dia nda. diay may not undarstand It waM anough io 
apply M corract So axamplaa mi^ ba an affacdva way to dardy and iau^trata tha 
larma of dia ruto Tho rasaarch of Tannyaon. Wooday and MarrM (1972) chad abova 
la ratavam hara; without dia right salacdon of aumplas. laarnars may ovarganarallza. 
unriarganarallza or misconcalva dia acopa of dia nda Again. In ordar for axampias 
ic hdW dils function. laa.*nara muai draw dia nawassary ralaUonsr.;ps batwaan tha 
tarma of dia axampla and diosa of dia rula. Tannyson. Stava and BoutwaK (1975) 
addad analysas of tha axampias lo a laxt taachhig sub)acts to racogniza matrlcal 
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iomit to poMy- Etch mmpl* wtt d K cmf d lo show how H m«i tht crHlctl 
■wrthum ol ih« mttftcai c a n go r y. TTm auttiort found ihM tubfoctt who rttd mo 
fc>Mt wMi ttiooo olitMrailono porfonnod bonor on a rtoooWcoilon look ihon tubjoctt 
who Mw iho unormoialod oxompioo. 

Ill oomrM 10 Iho prooodhiQ onolyiii. Iho wort of flodor and Andoroon (IMO. 
tM3). r'iMcrlbod Hi Chopior 2. OMgooiti ihot oliboroMono wM Impair rocaK ol tho 
Oinaraimloh and c onipfohoiwlon aooioa. hi ftwi, Mandl, Shnoiz and Toroan (1964) 
•aaoMMiy ropicaiod flodor and Andorton*o roouko. Thoy proparod two vorslono ol 
Ml Kipoalionr loxt on 'Man and HIa Cnvlranniani,' wWch dWarod only m that ono 
vacHon oomalnad oxamplaa of lha ganaral oonoapia. Uha flodar and Andoraon. ihoy 
lound ihai racai and co mprahanaion aooroa wort al laan aa good (and tomotknoo 
banaO ««ian lha laxt oomalnad lawar afahor a tlon a (in dHa oaat. axainplaa).** 

Aa m Radar and Andaraon'a aiiidtoa, pafformanoa in lha Mandl ol al. oiiporlffloni 
waa maaiurad witfi dadaraMM Maio in wMch tub|acia had lo racaS or mafco timplo 
Iniaianoaa oboui tfw mam oeneapc. not $pplf mm lo aolva proMoma. Wo can 
bffino tfwta roauHa mto Mna «Mi ttia daaaMcaaon and proMom-ioMno raaoarch cMod 
abova (wtfiora oxamplaa did Improwo porformanca) V wo aaaumo ;hat m bom 
rt iMW c a ilon and problom-MMnQ taaka. axamplaa holpod poopio apply lha rulaa. m 
lha oaaa of daaoMcailon. ow laamar may uao • njla lo last whaihar • putatlva 



mMmm «!• ^tmtMr-i mm il rt t r t n a mm t m fh t v MtNt or MM lo n p n aq n > wnnom 
•i«0<<<t«ton. 
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mombof of a clats fnaai$ iha nocauary and suHiciani conoiiions for mafnoorship 
In tha casa ol probiam sotvkio. such aa laarrWng to writa corraci compuiar 
commando, laamora uta lha rulat lo ^%(\%%%\% compoiar coda mai maaia consiramta 
•podNod m tho rulM So tha valua ol oxamplaa for holping loarnora rofnambar or 
undoraiand rufoa (at loaat to tho axiom ol boino ibio to anawar comprahanaion 
quoaHona) la atir an opan quoatlon 

ft a^? lomama to ba aoon whothar axamplaa ktcraaaa laarnara' apiltuda for 
foNowInQ advfca. Tha final two foaturoa of axamplaa Hatad abova may ba raiavam to 
tMa qoaatlon. Fkat. axamplaa may hava an important rolo for aatabUahing tha truth 
or tho uUMy of a rula (Paralman i Olbrachu-Tytaca. 1M9. Schoanfald. 1979. Mandl 
Schnoct 4 Torgan. 1984; (Siaon & Abalaon. 19M). Soolng a varlaty of axamplaa 
may oonvlnco foainara that a rula la truly ganaral. Saalng ralatlvaly aasy axamplaa 
may convlnca laarnara mat a rula la aaty lo apply Thia affactlva function of 
axamplaa may ba panicularty NTvonam whan tha luia la a hauriatic or a piaca of 
a<Mca that laarnara ara not obilgad to follow. Saatng caaaa whara uaing a hauristic 
graaily facWiataa probiam aoivlno may convmca laamarf to uaa It thamaatvaa 

Finally, raaaarch in afcM acqulaHlon auogaata iha* paopio who ara laarmng math cr 
computar proorammlng raly haavily on axamplaa of corractly tolvod problama aa 
modala for aoMng now problama PIroM and Andarton (1965) obsarvad subjacta 
laaming tha programming languaga LISP Thiniong aloud protocola ravaalad mat tha 
sub)acta draw dataVad analogiaa bahvctn tha probiam thay wara working on and 



'Or. M m«oy orowt. i««<nort Ooctdo er» • puiMlvo mof^Mf Or cktwtna ontloaio* Dotwoon h ono 
knowA mombofs tna norunombors <0 9. Htnttmon. tfOOl, or • a«noroNtoO proiorypo (of!. RoMti. 1177) 
lA iMt cooo. Iho oiompto It •orvma ot • modol rotftor lh«n ot on owiMory «id roi romomborloa o< 
uAtfortiOAdlAa itto lorms o( tho fulo Soo Iho tfiMusstort o( oiMtptot ot modo4 Ooiow 
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wQiMM •xamplM tfwy had Ntn In Iht InttfucHonal Itxi. Tlw •wmpi* ••rvtd m 
• model or mmpim for ttw ooMlori. RoHonoo on oxomplot m modolt hot alto boon 
tfooumomod to o«ior pioWom domotoo. tucn at loomtoQ lo oo^ onolooloo (lofovro 
ond Mion. iM4). 

3.3,1 Concopiuol Exomploo and Took CKomploo 

II ton*! door wMch of Iho lour aopodt of ow nploi dotortbid obovo oro moot 
bnponani lor tidtl looming. Tlw proooM woili lafcoo aiopo loiiard dUdnQuliWng tho 
Inotandadon fcatcdon of axamploo Ironi Hia 'modol* ftinodon* For dilo purpoto* I wM 
olioracioitM akmwIm Oiai ImimMoio nanofii oonooMi oo ooneaor oxamo'tB and 
Mf0fted4iui niTiiiiaina iitfli an dioaa ioiind to a amA or Braarammtoa iaxtlMMk. at 
laift o g a ay lia Thaaa mo lypaa of o aaw plaa ara abnlar to wtiai Mandl. SciMoa and 
Targaii (iM4) call 'WunraHw OMaiwplii* and 'appMlon OKamplaa/ raopacMy. 
(Both typoo of ownploo pro^Mo ipooMo tooiantlailono of Hia gonoral tonno of a njto« 
DW wio lypoo oaior in wnoi oaior paioa or ■wonnoaon aioy priMoo> 

To ttuMraia tfio tmo Undo of aiamptoa. oonHdor too MowtoQ throa aomoncoo. 
Hia ifoi la a atyltoHe nrfa. baoad on WMama (iMt^ Tlta lacond la a concapi 
axampla of iba nito, and iba tobd ti a latii axampto: 



!• Ryla. Wban a nomlnakailon lolOMa an amply vaib* cbanpa tba 
nomlnattiatlon lo a vofb ibii raptaoaa tha amply vafb. 

2. Canoa^ Kxampla. For oaampla* nomtooMnilona aucb to MvoM^aifon^ 
mqulnf or ivapoma ofton lolow ompiy vaiba aucb aa ma*a or conoid 
Uoii Iba varba tovaallpaii^ toguim or mcpond Inaioad. 

3. Taab Baampla. For axampla* obanga Ilia aamanoa *Tha poNco 
oondudod an aioamaty tborougb tovoattQailon Into too inddam/ to *Tha 
poica tovoabootod tba tn d dam tHtfttfttly tborouobly.* 



yho concopi oxampto Inala n l to iao tbo gonoral lorma *ompiy vorb' and 
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'nomlnaKzation.* but do«sn't provkia a contaxt Ut which thay fnlght occur Tha task 
axampla toatantistta iba ganaral tarma within a spaciflc contaxt Tho coniait 
Muaualaa aomatbing about tba aUuailona m wblcb tha t\A% should apply iha 
nomtoaisation naad not follow iba amply varb diractly. H also Wusiraiaa somaihing 
about bow to carry through iba aolutlon: changing a noun to » -arb can nacaasltaia 
cbangaa to othar parta ol iba aantanca 

ff InatanUatlon la tha nia)or conirtbuUon of an axampla. than concapi axampiaa 
and taali axamplaa ahouM aid parfomianca to tba aama dtgraa. But » ll ta 
toiportam to uaa ibo axampla m a modal, than aaaing a laak axampla thouid 
toiprova parformanca mora than aaaing a concapi axampla. Task axamplaa may atao 
bulp paopla ramamba^ a rula whan ibay ara working on a task, bacauaa atairg iba 
laak may ramind Ibam of tha axampla (Roaa. IM4). FlnaMy. Iba laak axampla may 
ba battar for damonatrattog Iba utHlty ol tba advica. by ahor;ing rathar than luai 
aaaaning that foNowtog iba ruia laada to a daalrabia outcoma. 

3.4. A Pravl«w ol tha Expgrimant 

Tba purpoaa ol iba axparknant la tr diacovar wbathar or not aiaboraNng on 
aalactlon fftformatk>n Improvaa laamara' parformanca. and If so. vthai sort of 
alaboratlon la most affactlva. At iba and of Cbaptar 2. thraa fasiuras wara 
daacrlbad that may control wbathar alaboratlona hava a chanca to improva 
parformanca. tha taaka must ba onaa for wnicb tha Information is raiavsnl. Iha 
ataboratlorj muat ba iba rlgbt kind and tha InformaikMi muat ba a typa thai banaftta 
from olaboratlon Of thaaa Ibraa faaturaa. only Iho naturo of ibo taako and tha 
natura of Ibo olaboratkNW can ba varlad axparimantally If wa can Knd a taak m 
wlilcb aoma typa of salactkKi alaboratlona Impro^.'a parformanca. than obvloualy 
aalacikMi lnformatk)n la a (ypa that can banafll from alaboratlon. 
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Vm Mptrlmtni to tm rtpodwl htrt ctum condMont umitr which Mixtion 
I n te nn tion ahouU tm MeMy nkM&M to good iMk ptrformtnc*. A Ml ol pro6l*mt 
WM ooramidtd wWdi eouM b« tolMd wMi vMtout combintiont ol pcocoilirot. 
8ub|ocit wtrt mtmidid lo M tfw fiM fMcM oombMlon of procodurM to tolvo 
MCh ono. Sonw «ub|Mii roooMd atfuloo on wtiih « pcfUeulir proooduro wti moot 
oficM and tomo dM noi. N tucti n U cd on MoriMlloii to mdMd rotovtm to tho 
IMlit. dwn tubioott who no odvfco ihogM ptflomi honor thon thooo who too no 
•di4eo. 

In til Mompl to mcrooto Iho MtoNhood ihoi iub)ocit Mow iho advlco. tomo 
praWoiM woro do H pnod to bo moro dNHcuk W.OA tio oihort.' Tho rotlOMlo lor this 
fnompuMoA it M •.'^-'-xt. Smco odvteo m our doHnMon to dtocroNonry. tubloctt 
moy dooWo not lo follow li;»oymoytiyiollnddiofflOM olflctom toluMon looio 
odtor wty. luoh u ceundng dio numbor ol tlopo m ooch poMlWo wkiilon and 
compodng ihom unM thoy hovo lourl Iho (notl oMctom ono. If oo, ihon wo moy find 
fio oMod ol odvlco or olaboroilont simply bocMJOO iub)oct« profor to uw thoir own 
modiod or bocouoo oMhor moihod aiowt tubfodo lo find mo rigM an«Mor oquoliy 
mtttff. To onddpato Ihia poaaMMy. half ol iha problama waro daalgnod to bo mora 
dMncuH; thoaa problama havo a o^iar munbor ol poaalbia aoimiona. aach with a 
Oraoior numbor ol aiapa. 8ub|acia may than ba unabia lo manuNy computa a 
aoMlon by ooundng and comparing aiapa. So whlla aubiacia mighi ba contam to 
oompulo aoMlona for iho OMy problama. ihay may havo to fall back on tho advica 
for Iho hard onoa. 

II Ma analyala to corraci, ihan iho avidanco that advica banalMa from •laboratlona 
may appaar only for iho hard laaka. Thai to. aubjacta mlgM noi foiow iha advico on 
aaay taaka, to ihara would bo no dWaranca wi partormanca for aub|acta who hava 
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laan toma lorm of advica and ihosa who havtn i Howavar. on hard task?* subiacis 
ihovM ba much mora Wkaly to banafli from iha advica And II aiaboraitons ara 
noodad ki ordr for tub)acta to laka fuN advaniaga ol tho advica. man subiacts who 
aaa advica alaboratad wfth axamplaa ahoukt parform much btitar than atthar sub|acii 
who aoo unolaboratad advk:a or aubjacta virho too no advica. if laalno axampiai 
makaa no diffaranca to parformanca avan on hard ii»Ka. than wa may hava found 
anoifiar altuatk)n m whk:h aalactk)n InfofmaUon faMa to banalll from alaboratloni 

Tha naiura of tho alaboratlona wW ba manlpulatad In thli axparlmant by providing 
tHhar concapl axampiai or taak axamptoi to Wuitraia tha advica For tha raaions 
daacrlbad In tha pravloua taction, axamplaa havo baan found to ba vary aHactlva 
alda for laarnlng to apply rUaa. Slnca advtoa to i typo of rula. wa would axpact 
axamplaa to ba tha batt kktd of alaboratlon Howavar. It to not canain what kind of 
axampio would bo mott affacilva Tha tactton on iumpto* abovt pratantad toma 
argumantt for wtty tatk axamplaa might ba mora affacilva ihan concapl axampiet 

An additional factor of "itaratt to how tanactoutry tub|actt •<3H\*f to advica 
IdaaNy, wa want iiudants to follow advica )udlck>ualy. to uta It at a racommandailon 
rathar than aa a commandmant In thto axparlmant. wa wW ba abia to gauga how 
ohan and how aagarly tub)actt foNow ma advk:a In two waya FIrtt. wa wtll taa 
whathar aub|actt follow tha advica on aaty tatkt (whan may migm ba abia lo 
computa tho tolutlon mdapandantty). at waH at hard tatkt Tha axparlmant alto 
amploya a mora dkaci maatura of how ohan tub)acta roNow tha advica This 
maaaura raHat on iha fact that advica to a haurtotic rulo r^mer than an aigorimmto 
rula. Thto maana mai advk:a to not guarantaad to toad to tha datlrad outcoma To 
raflact thto potaibillty. toma prbblama ffttt Jttlgnad for which following tha advica 
would laad to an Incorract tolutlon to the probtam If subtactt follow tha advica 
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dOMly, Hwy «M aniiMr liioorrtctly on Hmm probhmt. That It. subi«cit m«y foHow 
Hw cvM «^ N IM^ mm astray. 



5^ 




Chapter 4 
METHOD 

4.1. Ov«rvl«w 0^ tlM Box-World Qamt 

Vm oxiMflmMi Invdvtd a g«iM c«M •Sox^ortd/ m wNch timplt OMm«irtc 
Pbitdt w«« ditptaytd on a DandyHon cofr^^uMr. Each play of tht oama proMntad a 
9m/mn (a conMguratlon o< boxaa antf o(H«cta on mm scraon) and a goaf for what 
otolaeit particular boiaa ahouW oomain (aaa FlQora 4*1).*' Vm goal could ba 
•cNtwid wWi a comWnaHon of oocnmandi for mo^ objM^ia from ona box to 
•nomar or i^woQlno i> objad'a thapo. to ona taak. iha EMdancy taalL tfia objact 
of iha oofflo wM to nnura out iha moat afflcJoM comMnailon of movaa and changaa 
for odilo***; goal. Subjacta pwformad Ma wwt mamaly; tOay didnl ac^uaKy 
IMW Iha oommanda to iha eompmar. Whan aubfacia ballwwd thay had arrtvad at 

moat afndam soluUon. thay aionOad tha eompmar by praaaing a kay. Tha 
oompiMr propt ^ an acaton (aaa Figura 4-2) tor acMavkig pan of tha goal and 
tublactt hao lo dadda whaiher or not tMa acUon waa pan of tha moat aWdant way 
10 achioM Iha goal. Thay HgnaM ihalr dadaton by praaaing aHhar a kay labaNad 
*yM' or ona IcHaHod 'no.* 

Tha moat afnuam aoMlon path to a goal la df larmlnad by tha total numhar of 
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tndl'^ual Chingt and Mova comr.iand* rtqulrad In ordar to find tha moai iHlciant 
aokiUon path, aubiactt had to taka into account «oma rastricilons on shapa changes 
and movtmtnta. Ona tat ot raatrtctlona affactad how many commanda would ba 
raqulrad to changa an ot)|«ct to anoihar ahapa. In particular. ih« tlva kinda of Box- 
Workk objacta (irtangla. diamond, paniaQon. haxagon and hapiagon) wera rankad 
according to how man^ tidaa th^fy hava (la.. Xt^%: tour. nva. tlx and aavan %\<4%, 
raapaciMly). A aingia CHANGE command can changa an ob}act onty ona dagraa up 
or down In rank. So, tor axampla. a diamond can ba changad to aithar a inangia or 
a pamagon wMh a aingla command. Howavar. a taquanca of two commanda wouki 
ba raqulrad to changa H to a haxagon. or Itwaa commanda to changa It to a 
hapiagon. SknNarty. tha movamant ol an objact from a glvan box waa rattrictad to 
a box naaiad dfracily abova or balcw tha currant box Su a aaquanca of MOVE 
commanda wouM ba raqukad lo mova an ot^-^t to a mora dlatant box. Thata 
raauteUona ara axpialnad mora ^JUy fci tha Dox-wortd manual, provldad in Appandix A 

4.2. Design 

Tha axpartmant indudad two tuka using tlta Box Wortd^ gama •.•«t antptoyad 
aomawhat oNfarant daalgna. an Efftolancy taak and an Advk:a RacognitkKi latk rha 
Effldancy taak t^^^M^.H aub)acta to find tha most aHtCf«nt ;okjik)n lo a -^'obJam 
Tha Advica Racognltlon tatH raqukad tham to dadda whathar or not a propotad 
actk)n waa conalaiai*t with tha advica 
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4 2.1. emdincy Ttak 

Tlw iHdiiwy tMk rvquM tuMMtt lo And th« mott •mdtnl solution to • 
praMtm. TNt tMk «npioyod a 4x2x2 mtxod todcMM tfMign. Tho flrti factor. 
mmicMOfH m$ • batwta n g u bta cH tedor that manlpMlaiad tlw i i^abW t y and form 
of advtot in Mnictlor^ mmM iNM tublacii amdM. Four varalona of tha 
fiwiartala wara avalabia: No AO^ Mute Mmai Huia fika Coocapf Cxampfa ann Aj^ 
plM r«i* ficaaipfa. Sut)|acis wara randomly saalgnad to nudy ona of ihaaa varaiona. 
vHtfi ttv^ o'Miairaini ttiat dia lour groupa eontaM an aqual numbar of aubjacta. 

Tha aacond locior. Appropitaianaaa, waa a «dtt*vaub)acta factor that manlpulatad 
dia typaa of Mala m iha tox-Woild gama. Thraa^uanara of tha trtala wara 
Apfimptm and onaWtar wara ^n^xMoprim. On Appropriata irtala. fodowmg a 
airaiagy cenalaunt wMi Pw ad^ In ^ manual lad to dw meal afHdam aoludon 
(and ao dta-oorrad anawai). Cn mapproprlaia Mala. iMa atratagy lad to an mcorract 
raaponn. Tha pivooaa of iNa factor was to maaauro how apt aub|acia wara to 
flolew tha »Mea; Ma ctoaar diay Mtowad tha advlca. Ma mora Kaly li waa that thay 
would ffaapond oorracdy on Approprlaia irtala and Moorracdy on Inapproprlata iriaJa. 

Tha tMrd factor. OMteuky. waa alao wlMln«ibiacta. For ixMh lavaia d 
approprtaionaaa. had tha Mali wara daaignad lo ba £4sy and half wara Cmcuit 
OdHoulty waa datarmlnad by two KtMntm: tha numbar (4 piauaibia nolwjon puiha for 
acMavMg tha goal and Ma numbar of itapa k\ Ma moat afHdam aoludon path. 

Tha paramatar of Maraai tm Ma aubjaci'a dacWon abr d whoMar an action 
propoaad by tha compuiar waa part of Ma moat afddani solution paM. So tha 
dapandant maaauraa wara dta accuracy of dtaaa dadslona and how long iMb|acts 
took to raspond. 
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4 2 2 Advica Racogniilon Task 

Tha Advica Racognhlon task raqulrad subjacts lo daclda wheihar or noi a 
proposad action wu consistani wiih iha advica (ragardlass ol whaihar ii wis pan ol 
ttM most affldant'sokitton). This task amployc«i a 3x4x2 mixad factorial dasign Tha 
fksi factor was agawi ttia *Mtwean<groupa factor insiructkNi. Insifuctk>n had inraa 
lavaia for this task, namaty Hm ihraa varslonc of iha manual inai coniainad soma 
i^rm of advtoa (A7u/a Ak>n€, Rul0 pktt Concr ^'vnph and Rut* plus Tmsh Extmpt*) 
5ub|acis wara asslgnad to an InstructkMi conditkKi bafora compiaimg ina Eftlciancy 
task and kapt tha sama asslgnmant for tha Advica racognitkMi task ^* 

Tha sacond factor. Advlca-Rasponsa Match, wu a wHhin-sub)scts factor of trial 
charactarlatlca. Thara wara four trial catagortas; (/sa*ya<. Uf No. Don't use-Yes Don't 
UsaWo TrlM wara catagorlzad as Usa or Oon't Usa according to whathar iha 
•dvlaad siratagy would dictata using a particular command for that sttuaiton or 
ovokflng that command. Trials w«ra caiagort^ad u Yaa or No according to whathar 
tha propoaad solution was consistani with tha advica or not. Ovarsii. inera wara tha 
sama numbar ol Usa trials as Oon't Usa. and tha sama numbar o( Yas's as No s, 
This factor Is dascribad mora fully ki iha Mala;lals sacikKi. and axamples of tha 
trials ara I .«idad in Appandix B 

'Hia third facior was Difficulty, u In iha Etticiancy task, half tha trials wara easy 
and half wara DimcuH 

Tha dapandant maasuras waia accuracy of rasponsa and raactlon timas 



Sub)*ctt (A m« Mo AovKt gioup «Im p«rfo«in*tf im Atfvic* RvcoQiUdor) iisk. in o«d«f ih« tn 
•uSi«cl« would f tiMiotf •qulv«l«Mty ThM« »ubi«ctt i«c«iv*d ip«c(«l biitructiont fo« ih« Mtk ihM 
pfM»Alotf • lorm of th« $&*k» Howtvtf. th« Uom ma No Advico group wtit not tncludod in iho 
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4.3. Itotiriait 

' 4.3.1. munictfonai Itaicrtili lor tm WorW 

Th» Mnxtfonol tmm^ conjUiid of a 4<pooo mamiol for tht Box-World 
program (raproducad In Appandbc Tha iwmial brtaiy IrNroduoad ttia Box-World 
domalii and «Mn daaciftad Wm Mova. Cnanga and Oaiaia commanda. TMt baalc 
.manual rapraaamad ttw No /Moa Mrvcdonal condMoa TVvaa oihar varnona of 
iha manual wara praparad wm dWara d only by tfia addMon of aoma lorm of advica 
tor how 10 uaa dia CtMnga or Mova co mmanda afldandy. Ona manual almply tiatad 
lha advtoa at a ganaral fula; dw othar two manuala addad dNforam Mnda of 
•xamplaa lo NMraia ilM advtoa. Tha diraa forma of adtrlca wara: 

* 8y!f Alona : 4ca tiaiad at a ganaral rula wW h ou t any alaboraiion. 

* fiyH fliUI Concaot Examola : AMoa aiaiad aa a rula wNh a vart»l 
mmplf QMng apacMo mm awla i iona of dia larma In dia rula. 

* fi^ filui TfSk Exanttlr. Ad«4ca aMMd aa a rula wMi an annoiatad 
pfemrtnl tfftfnpta of a la tf^ aliuadon ghowinQ ihai joHowlno dia advica 
laadi to dM mnai aNkted Mdutfon 

npura 4^ ihowa diaaa dvaa forma of advica tor uaing dia Changa command. 
To craaia ma manuala tor dw dvaa advica condMona. a ahaac comamino iha 
approprtofa form of advica waa Inaanad afiar dw da t c ri pdo n of tha Changa commar ' 
In dia baato man u a l . 

Tl»a Mava laamofpfi. Tha acMca idd tublacta undar what condMona to uta a 
particular procadura and whan to avoW uaing K. Sine* dw manual daacrtoad two 
ma|or procaduraa (hia Changa command and dta Mova comntand). M waa importam 
to vary wMch procadura lha advica oorwamad. whNa holding conttani aa many of iha 
talk laaiuraa aa poaalbto. Accordingly, a lacond aof of acMca waa praparad that 
concama d tha Mova command, ihown In FIgura 44. 
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FIGURE 4 3 



Three forms of Advice for ihe Change Command 
a. nULE ALONE 

CHANGE 1$ usually the most elficjtnt command to uSt A<ntnevef /Ou can maw an COieci 
ipto lha shapa you warn oy iSSumg |ust one command oinerwise avoid us<ng CHANGE 



b. RULE PLUS CONCEPT EXAMPLE 

Change is muaiiy i.*c mosi efhcieoi command lo uje whenever yoi- can ma*e an OOjCCi 
into tha Shape you want oy issuing |usi ona commatid otherwise avOid uSmg CmANGE 

EXAMPLE use Change ^nen you have a diamond and need a iriangie o' a oeniagon 
you can get lo either of cnese shapes ^iih lust one command Look lor anoiner .va, to 
sotva Ihe problem if you nave a diamond Out need a hexagon or a nepiagon 



C. RULE PLUS TASK EXAMPLE 

Change is usuaii^ me most afuciem command to use /wnenever you can make an Ooieci 
into the Shape you want Oy issutng |uSl one command other.xsc avoid usmg CHANGE 

EXAMPLE Consider the followmg 6ox- World stluanon Suppose you want BOX A lo contain 

two triangles Changing 0»AM0N02 mio a cnangle lahes only one command and is more 

errictertt than changing PENTAG0N2 »nto a inangle j2 cnanijesi or moving TRiANGu£3 ^n 
BOX-B 10 BOX A (2 movesi 
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' Tht— forms of Advict for Movt Command 

•. mitf AtONC 

MOVE »• u«o^ m« mo»t tifccitn comnwd to um wntntvtf .ou can Pui cn» Ob|tci 
tt)« 8ox you wtnt t>y itsum^ |utt ont coflwn«nd. otncrwiM avon'^ u^mg MOVE 



b. ftUU n.US CONCEPT fiXAMPLf . 

MOVE « usually a»« moti aHiciani command to usa «»f»tnavaf you can out tna Objoci mio 
iDa Box yoo «am tiy tauMg jusi c<ia command: otharwiaa avoid utmg MOVE 

WMPiB Uaa MOVE ^•nan you nava a diamond « BOX A and oaad a cuamood m timer 
BOX'S iwincn 1$ tnsida BOX A) ot in TOP iwftch contamt BOX A). you can ga» to t«her o« 
mtM bo«at *im iuat ona command Loofc lof Mn6it\f way to towt ma pfoWam •! you 
naad a diamond m any otnar Box 



c. flUCE PLUS TASK i/AMPLE 

MOVE It usually ma most •Htoam command lo usa «nancw yo»i can put iha Otoiaci mio 
iha Box you want by tssutng tutt ona command, omarwtsa av^d u|^ MOVE 

EXAMPLE. Coniidaf tha loHowmg Box-World Wuaiion Suppota you want BOX A to conum 
two Ifianglas Mo»^ TfliANGLE2 «rom BOX-B lo BOX A taka* only ona commind and - 
moca aHloart man movmg TfllANGLE3 Irom ""JX-C to BOX-A (2 movasi or chang.ng 
PEHTAG0N2 into a iriangta |2 changas) 
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In ofdar to baianca tha location of ma advica. ma »rdar ol lopici m m« manuai» 
was contfoOad. whan ma manual contalnad «dvk:a about ma Changa command m# 
dlacuaslon ol tha Changa command loHowad thai ol iha Mova command When the 
■dvica concafnwJ tht Move command, ma diacun n ol me Move command loHowed 
irai ma Change command Separaie wtlona ol tha No Advice /enion ol the 
manual. rapreMntmg each topic order, ware alto prepared 

4.3.2. Trials (or tha Box-World Gama 

A pool d S4 Box-World problema wa<) prepared, each conaUitng of a siiuatlon. a 
goal and a proposed action that was coded for a correct retponte (etmer Yes or 
No). Tha conttructlon of the irlala Involva^' lour lectors. Appropriateness. OHHculty. 
Uaa and nasponaa (sea bak)w). The four facuxs were completely crossed, yielding a 
4x2x2x2 daalgr. (me Hrat facior rapresants tha dIatrlboUon of three Appropnaie irtais 
for avary lnappropr»ate trial) Consequently. 32 tnais were needed for one complete 
rapHcailon and iha 64<fiom pool rapresaniad two compiate repHcailons 

TMa pool ot Heme was used for both iha Efficiency lask and me /dvtce 
flecognMon task. A fixed sat of 32 probiems was usad in tha Advice flecognliion 
task. Tha proWama ware choaan randomly from the pod 6f 64 problems. »v«ih me 
conairalm mat me sat of proWama for each lask should represent one compieie 
rapHcailon ot iha experimanial design. Tha cniy modlllcaiion needed for using the 
problems in ma Advk:e flecognliion task was an adMiment in the coding ol the 
conact reaponaa. 

Each Box-World Situation presamad lour to ten ob)ecis arranged mslde any of 
two to six boxes The Goal specified lor one or mora of me boxes whai ob|acts (if 
any) they should contain, The Action siaiement described an action performed on 
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luM Ofw of tf» U>Hctt. mm chtfiQlno Ms or movlfio lo anoitwr box. ($•• 
ngim 4-1 Md 4<2.) Tht tptcMM chiiiot or movumont in mo Acttofv wm not 
•Iwcyo oomlium m\ iho atfvloo. Thoi it. tfw Action iioiomoni mtght pfopoto 
ohonQlno % dtomond to • hopMoon or movlnp an obfod fo o dlotonl box. Tho 
Action m» aliMyt pan of o plauaMo aoMlon lo tfio praWam and waa unlquo to ono 
aolmion pain. 

Apfii^)nmn0u PlaualMt aoliiMona vvart oompulod for aacfi SMuaUon^Soal 
ooMblnailon* If tftara waa no ono loMl cn ttiai Had fawac aiapa than tho otttara* 
than dw proWam was dtooardad. If lha moai afKdani a oiudon ra^ulrad \4olailno ttia 
d<Moo (••O-* H caSad for ctianQinQ a dtamond lo o tiapiaoon)» than dia problani waa 
olaiiWiJ aa inappropdait. If dia baal aoiudon dM not violito dia a^vica. dian dta 
proWam waa charactartiad aa /wopitaia. Tlira»4oiifdia of dio iriala Ir. dw Anal 
pool of proManw wwi Approprlaia and oiia foiMdi wara Inapproprlala. 

OM0i%. Oddojliy waa daianidnad by two fadora: dia numbor of ploualblo 
aoiudon padw for achMno dia Qoal and dia.numdar of aiapa m it moai adldam 
aoiudon padi. Tharo wot an awaraga of 3.7 plauaMa podia par problam for aaay 
proofama and 4.4 padia for bard proMania. Tha moat afflolani padi for oaay 
problonia avaragad 3.S aiapa; for bard proWoma. dm avoraoa waa 4.4 aiapa. 

OM>ont Um. Tha Uaa fador varlad wfiadiar dia advlaad atratoQy would Jdoto 
ualriQ 0 pMdcular command m acMava a ooal or looldng for or. abamadva lo uaing 
dipt c ommand. Tiia adwtoc f a c ommondad uaIng dia Cbanga command undar caru^n 
olroumaiancoa, namaly whana w ar an ob|oci oeuM ba cbangad imo dio daalrad ahapa 
by laauind |uai ono command. TMa la dm poaidwa form of dia advlca. taMng dia 
•aublaoi le uaa dia cbanoa command wban dia iduadon mai cortam condMona. Tha 
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advlca atoo t\%t % ntgativf aspact it says to avoid using lha Changa command m all 
otnar cWcumaiancaa but x doesni say what to do Instaad Hait oi tha inais in me 
pool sailattaO lha condlitons in the advice, that (a. ihara waa an objaci thai could ba 
changad with ona command to a ahapa spKlHad in iha goal For iha other trials 
Uiara waa no ob|act that mat thasa condlilona. 

Aaiponsa Tha Raaponsa ^factor Inswad that thara wara an aquai numbar ol trials 
In which dia corract raaponsa waa ms and ttia correct raaponaa waa No 

Tha trtalt in lha Advtca nacogoHlon task wara daaalllad Inio lour catagorias 
according lo tha Uaa/Don'i Uaa dknanalon and tha Yaa/f4o dknansJon Us9Vs. Usa- 
No, Don't Uf-Yo$. Don't Us$*No Tha moat airalghlforwaid application of tha advica 
la axpactod to coma in aHhar lha Usa-Yaa or tha Doni Uaa-No catagoriaa In tha 
Uaa-Yaa trials, tha advica dictataa uakig tha Changa command and tha action 
atatamam propoaaa tha ralavan. changa. so tha corract rasponsa is Yas in tha 
Ooni Uaa*No trtaia. tha advica racommanda aga.>tt uamg dia changa. command (lor 
Inaianoa. whan thara ara no objacta availabia that can ba changad with )ust ona 
command Into tha daalrad ahapa). Tha action alatamant proposaa a changa thai 
vlolatM dia advica. so tha corract raaponaa la No. 

Samplaa o( trlala in tha ditfarant cond^*)na ara tound m Appandix B Nota that 
aublacia aaw tho irtala m tho lormat uaad m Figuraa 4*1 and 4-2 For aaaa of 
rafaranca. tha aamplaa m dia appandix Uai lha goal and action and ara annotatad* 
tMdi dia corract rasponaaa lor both dia EHlclancy task and dia Advica Rtcognition 
taali and axplanaiions ol how tha !flal aatlatlaa tha raqulramania ol tha conditiona 
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4.3.3. Tlw Movt Itomcrph 

11 «Mi Impor^t 10 u iKVty ittk Ivtiurtt c^*nsi«nl m »>omIM« whtn ttt« 
•(Met oonMmri m« Mom commond. Howtvor. foiowtng iho Movo tdvtct to solvt 
• praMm •vouW not iMd lo Hw tamo toMlon cs toNowtng iho Ct>«n0t a<lv(c*. 
Thorolort. liomorplM ol toch of iM 14 proMomo woro crooiod (thoso wM bo rtforrtd 
10 M Mtovo <tomorp/»#. Tho Movt toomoiplw woro cfootod t^f tyttomailcoNy 
tr o nolowntoo ^ attuoHoA. qmI and arJMon o9 oooli praWom to ttiot mo eokjiton pat»« 
and ttw numdoc ol t:apa par poih «nuM bo pr oaof^d and ao that foNowmo thi 
¥ «o advteo would load lo a aoimlon ihoi waa fonnoNy idamical to that m iho 
Gorr^^wndlno Chango laomofph. 

Cf^adno Iho Movo {aomorpha mvoMd a iranalatjn bo(^iroon dmnco of mo^ftmtn 
and ^Ifproo o# ahopo chonpai Cvoiy aiop In !:« aoludon path of a probtom that 
biMMvok. «. Chango command waa iranalaiod imo a aiap hwoMng a Movo c msM. 
and vloo voraa. For oni.^«. auppoaa dtat ono modiod of aoMng a problam would 
mvoM changing a diCiMnd Inio a haxagoa Qlwm iht ocnair a lm a on iho Chango 
oommond doacrlbod abovo. Ma maihod would lnvo»vo two aiopo (or two Changi 
oommonda). In 3ho Movo laomorph of iNa pr.tHom. changing iho ahapo twfco 
vanoloioa imo moving iho diamond to iho doairad location from (wo boxaa away. 
Tho moihod aiM Involvoa two atopo. iMa Hmo two Movo commanda. Tho mow 
laomorpha of tho axamplaa from ^)pondb( B oro found In Appondbc C. 

Bocauao ihia tranalatlon praaorvad a« of tho rolovam choractar!atlca of tho 
proMoma. tho tot of 64 <4ovo laomorpha hMod aa iho roqulromonts of tho 
axpodmamal datJc^ In addMon. iho tampang of proWoma choaon ior tho Etfldoncy 
taak and Advico HocognMon taaka waa poaafvad. Thai la. :ha aubjocta who atudlad 
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lha Movo advtca workad on tha Mova itomorpha of iha 32 prot)lafnt chotan for tha 
Advtc6 flocognHlon task, wh^a sub|tcta who ttudiad tho Changa advica workad on 
tho Chango laornorpha of thaio probtomt. Clfftrancot dua to ^haiher aubjacts 
atudloo s^Hco about iho Movo commend or tho Chango ^.ommand wiH to rotarrad to 
hancoforth aa tho laomorpii factor. 

4.4. Appartctua 

Tho axportmont was conduct td on Xarox ttoa Oandytton or Osndytk' - computors 
wtth 17-Inch. blt*moppod. hijh raaoluUon JapUya (t024 x 608 plxalt). Softwara waa 
dt/volopod to rocord and timoaiamp iho sub|acta' ratponaos. 

4.5. Sifbitcts 

Tho aubfocta woro tta siudonia and ataff mombara at Carnoglo-Maiion Unlvataity 
and Iho Unlvoralty of PHtaburgh. All aubltcta wora natlva apaakara of Engiiah, or 
fluoM onough to complatoly undoraiand Iho manual. Sub)oc'.« ioc«,vod a baaic 
componaatlon of aithor monoy (13.50) or daaa paniapailon crodtt in addition. aU 
aubfadf ww>ra paid a bonua of fivo coma for aach corroct roaponaa thay mada abova 
dtanco: iho highoat poaaiblo bonua waa $1.69 

4.6. Procgdurt 

Ono to fIvo aubjfcia wora run concurrmUy at Indlvlouai OandyHon workatattona in 
Iho firai phaao of tha axporimont, subfoct^ wora randomly aatlgnad lo aithar iha 
Chang or Movo laomorph and to oTfO of iho four inatrucilon conditlunt Thay wara 
givon thoir aaalgnad vorair «if tha manual and a ftx.^J ported of fiva minutaa in 
which to ra d \i Subjoda w« o told to rovlow tha lnformatk>n If tnoy flnlr*iod 
raading bofora tha fIvo mlcutaa wot a up. akico tha manual would not ba ovallabia to 
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mmn wNto Ihty worM on iht UtM. Mm ttio tludy fihf. MO)«ctt w«r* Mktd to 
do Iho EMdoncy took* • Rocol iMk ontf itw RtcognMon tuk. Sub|octt 

porfomiod iho latlta m iMo ordor to Hwt pofformonco on ono task woukJ not 

An imilol oroup o« 4t tubioctt (compotod prtmoniy ol CMU itudomt) d^l not do 
Iho Advtoo flocognMon losk; ttwy poflormod iho CINcioncy look on ol 64 proWomt. 
A iocond oro<«> ol W nblocii <prlmoflly m Mudomt) dM 32 triolo wWi itio 
Effidonoy luk »ii«inictloiit end 32 Iriolt wMh Iho Advteo RocoooMon kwnictkint. 
OMoroncoo b oiwoo n ihoto two groufM d adb|octt wll bo rotarrod lo honcofomi ot 
Iho noplciilon fOdor; iho fM graup wll bo rolorrod to ot tho ElfOily group and 
Iho oooond oo iho wniMi graup- 

4.t.l. CMcioncy Toak 

Tho oxact motfuctkma lor iMa laak oro prooomod in Flguro 4*&. 

ror ooch triol. tub|ocit woro prooomod wWi • tkuoilon and a gool (Flguro 4*i). 
8Mb|ooia wort .oowuctod to amdy iho oMuotton lor oa kmg aa ihoy Nkod lo figura out 
Iho moot •'tldoni conMnodon ot movoo and ahapo changaa to acMovo iho goal. 
Whon Ihoy woro roady. ihoy praaaad iho ipoco bor. Tho goal ataiv^noni diaappoarod 
and WM roplacod by iho oci:s^ •Mmom (flguro 4-2)» Sobjocta dacWod who*hor or 
not tho acdon waa part ol tho mod oHtdam addton. Thty algnaMad thotf roiponao 
by prooakig aktior a koy tabalM 'yoa' or a koy la.^aiod no.' Tho computor thon 
gav9 0 foodbock moaaogo I4"^2 tho aub)od whothor tho roaponao waa correct or 
nd* It tha raaponao waa r ,ad» tho acoro Vi tho lowor righthand cornor ol tho 
Kroon waa Incraaaod by ono. Thora wara Nvo pradico Iriala, during whJch aub|ada 
woro ai o wod to ask quoadono abcui iho pr^^odura. 



FIGURE 4-5 



inatnictions for th« Efficiefv:y Task 

Now you wtl play a gamo utkig Box-WorM. In oach p^ay ol tho gama. yoj win saa soma 
8o:;ao and Ob|oda on tho icraon and a goal lor what objoda you want cana'/i boxat to 
contain. Tho compuior wW propoao an adk)n that may or may noi bo pari ol tha mott 
offldoni woy 10 gd to Iho god. (Tho propoaotf adkwi wM novor bo onough to gat to tlio 
god al by lladi, but k may bo ono d Iho Mnga you wodd want to do) Tho objoct d tha 
t oimo la 10 doddo whothor tho propoood odSon H part d tho moa' aHlclant airatagy la 

raadring tho god, thoi la tho draiogy udng tho amalad combkiatk>n d tha Box Workl 
commando you rood abod. II you Ihink tho propoowJ adkm la pan ol tha moat a*flclont 
airaiogy. prooa tho koy loboiod 'Yoa.' tl you ihk* ka nd. praaa •No * Each tlma you 
aro oorrod, you acora a pdm. Each dma you ara «rong. iho computar acoraa a point Aa 
your Bonua, wa wM givo you a ddid lor ovory pdd you acora. but aubtract a nk;kd Irom 
dio Bonua lor ovory pdm tho compuior acoroa. 

Tharo ara two knportam thkiga lo know abod tho ocdona that iho compdor wW propcso. 
(1) TMa acdon wM doac/lbt akhar tha «nd poddon or tho ll«;d ahapo d ono d tha ob|acta 
Canykig od tftia acdon moy lako ono or mora aaparata commanda. Tho moat •mwt 
I adudon la baatd on dio amoNod numbor d aoparda oommonda M wodd taka to roach tho 

: goot (2) Tho propoaad actkMi may bo to changa ttio ahopo d an Obfoct. To roach tha 

(goal, you ndgM havo to movo tm Ob|od too. Similarly, you might havo to changa tha 
ahapo d an ob)od that ttto compuMr propoaoa to movo. Aa k)ng aa you think thia 
ooquonoo lo part d ttio moat oMdoni aokiMon to ttto prodom. aay 'Yaa.' II K'a not. aay 
•NO.' 

! Hora la tho procodura lor aach play: 

(1) Praaa ttto apaco bar. Tho compuior wMI daplay a attuatkM and a goal (printod on tho 
• bdlom pa:3 o' ttto acroon). 

(2) Prooa ttia apaco bar agdn whan you ara roady to at^ ttio propoaod actk>n Tha goat 
ataiamani wM diaaopoar and wW bo roptacod by ttio propoaod acdon. 

(3) Koop your toidox Nngora rooHng on dio YES and NO kayo. Praaa tha kay laballod YES 
d you tidnk diat dtp propoaod adbn la pad N tho moTi a»kHant way to gat to tha goal 
Praaa dia kay labuNad NO d dial acdon la not part d dta moat amdont aoHJik><t 

(4) Tho computiM WIN ton you whaihor or not your dodaton waa right and updata iha acoro 
(6) To atart dta no... May. praaa dio apaca bar. 

Wr want you to play aa quickly aa poaakJia and atW gat a high aco^a. in ,ordor lo lai you 
got uaod to •ho procodura, diara wH bo f»va pracitca playa Arat You wtti ba abta to taka a 
braal-. bad-way through dio gamo. 
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For Mct) trial. tn« compuior rocordod ttio i«0ponM. wtioihor H wat corrtc or 
InooffOd* wid two rooponio tlmo imorvoli! 

* Gtoodhg 9na pt^nnkig ^mr/ik ttw Umt ihot otar.aod t>oiwo«) m« Mtiai 
prMonutlon of ttM tHuotlon end wDon Hm lubloci proMOd ttto tptco tMir. 

* Otdtton Mirvoft Iho mm botwo n iho pruMfiiaiton of iho actloA 
•tttomonl tnd whon tubloct t iQ n Ikid • docMoo. 

Tho compulor goncratod a dNIarani random p ra ao n taHo n ordor (or oach aub|act. 

4J.3. RacaN Taak 

84JlHaGia wara aaliad to witia Hwrt anawara to t-3 quaattona. Tha axact 
quaadona ara proaantad in riQura 44. Tha numbar of cuaadoM that aub)acta 
anawarad dapandad on wMeh varaton of tha manual may had ttJdl^d. Subiacta who 
had aaan axamplaa m ihalr manuala (l.a.» iha fluia pM Concapt Cxampla and tha 
nuta plui Tiali Exampta condtdona) anawarad Quaadon t. wMch aaltad tham to racaN 
tha dxmpla. Subfacta who hod aaan any form of advtca (l.a.. tha iwo axampla 
oondMona and tha Rula Alona oondMon) anawarad Quaadon 2. which aakad tham to 
racad dta advtca. AN all^lacla anawarad Quaadon 3. wMch aakad aublacta to 
rairoapaet on tha atratagy thay had uaad fo mK« tha problama. 

4.6.3. Advtca f^acognMon Taak 

Tha axad ki«trucdona tor iNa taak ara »iraaantad in Figura 4-7 

In INa taak« aubjacta wara Nrat ramkidad of Uia advtca thay had taan in tha 
manuaL Thay wara tr^own dw paga ^ dw manual wtdt dia advtoa may had ttudlad. 
mckMdng axamplaa m tha approprtaia condWona. Than ma mblacta parlormad a 
aartaa of 32 raccgnHlon trtala. m aach tf «l. iub|acta waia praaan;ad wtth a altuatton 
and a goal (Figura 4-t). Sub|acta aiudlad ma attuatkm (or at long aa thay Nkad. 
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Whan thay praatad iha spaca bar. tha goal dlaappaarad ind was rapiacaO by tha 
propoaad actkm (Figura 4-2) Subjacta dacklad whaihar or not iha action was 
conalaiant wHh tha advica and algnaliad thalr ratponaa by prattmg aimar a kay 
labaNad *yaa* or a kay labaNad 'no.' Tha computar than gava a (aadbacK 
maaaaga 'aMng tha tub)act whathar tha ratponaa wm co-aci or f>ot i( iha 
raaponaa wu corract. tha tcora m tha lowar righthand comar ol tha tcraan wat 
mcraaaad by ona. Thara wara (tva practk;a trlaJt. during which subiactt vrara 
aaowad to aak qbotilont about tha procadura. 

Aa (or tha Elflclancy Tath, iha compoiar racordad tha ratponti (or aach trial, 
whamar tt wat corrac? or Incorract. and tha two ratponaa tima ^ntaivalt Tha 
computar ganaratad a random ordar (or pratanting tha ulalt (or aach tub)act 
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FIQURE 44 
CKMlkNit III tiM CiMd-ftocaN Tuk 

1. Vm MMUil lor aoK-WoM «wl you iMd oi tfw bOQinning of 
'oNifod ooMio ^$4^ and on o a owpli liboui wtton lo mo tfi 
down iiM you lomombor of iio O M OWpH 

X Tho •ox-Wodd nwnuil olftiod tow odijci obom nMn lo uoo 
WMM doiM wilol you roiMflMr of 3lio o^tlco. 

dw Mra^ yni mod 10 ioft« dw prdMomo. 



•xportmoot 
Wrlli 



FIGURE 4-7 

Instructions for th« AdvJco Rdcognitlon Task 

TMs llnsi port of Iho i-poflm^w mvoMs snodior Qsmo. In two p«t d int tipodmont wo 
•TiTlJSIlJd m wtlShoM^ propoood .cdon IS port 01 Iho mo« •^J^^'^'J'^y^'^^ 
^ oool. Iimood. wo you 10 doddo whodior or not dio propostd .ctton foiiowt m 
S^you w^Tki dio monJ^ In ordoc lo r.mmd 

yduisod^f dio sd^. youmsyoowio^d»stpsfloofd»o monuol {•tiBcH^l 

Tho proooduro for pisytno dio Is sknisr to dio proi(touo psmo. ojccop? ihsi tn«ood ol 
ly^TSd dio W^offtdsTsoludo^ you or. simply docMmg ^JT^*^, 
"jiS, ^ .^Mco or not In odior wordo. doss dw proposod sctlon accomplish part 

TS^'iSTu^^X^^^^^ 1^0.0 d- My labasod -Y^- If 

yw dilTdio propoood aodon Is conslsisni wMi dis addco. a^ d K Is noi part oMho 
5Sii\!wom JoM^ -No- d you dunk dio scdon la not coinWaoi wWi dia «Mca 
^^mTfcT^ youacoraapomt Cachllmoyooar. wrong, ma compi-ar 
M^aa a pirn. Aa your Bonus, ws w« pKo you s nteW lor avary pom' you acora. Dm 
luMract a nickal from dia Bonua for ovary point dia comptior acorat. 

Haro la dia procadur; lor aach play: 

(1) ff>raaa dia apaca bar. Tha compuwr w« display a aHuadon and a o<M (prtntad on iha 
honom pari of acraan). 

(2) Piaaa dta apaca baragakiwhanyooararaadyioiaadia propowd action Tha floai 
atatttnam wfc diaaooaar and wSl ba raplacad by dia propotad action. 

131 Kaao vour mdax dnoara raadng on dia YES and NO kaya. Praat tha kay labaNad YES 
d^yoTSJT^^ !• conalaiani wdh dia advica. Pcaaa dta icay labasad 

NO d dial action la noi conaHiard wMi dia advica. 

(4) Tha compuiar wMI laN you whodiar or not your dacMon waa rtght and updata tha scora 

(5) To aian dia naxt play, praaa dia apaca bar. 

Agaki. wa want you to play u quIcMy aa poaalbla and am o«i • high acofa 
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Chapter 5 

RESULTS AND DISCUSSION. PART I: 
7HE EFFICIENCY TASK 

5.1. Ovofviaw 

Tlw cMrai iMit M M nprnkitm ft Iht Cffldtncy iMk. Tn« rMuiit from iNs 
tuk apMfc 10 ttM roNowtno four fc«y quMttofii: 

t. Old StibiKis Mkm M acMca MtitA SMrcMno lor ttw mott oWlciont 
•oMkm 10 a probtoM? 

2. ^ ttM ««Mco hc;»^ TM ii« tMTo tublictt wtio lolkmoci mo oOvlco 
•Uo 10 idonMfy Hio moM oWdoM toMloo moro omMonily or mora 
quicMy man aub|acts wDo dMn'i too any atMco? 

3. 0!4 iho dNNcuHy of iho tatk aflact iio tuMM^'t raManoo on tha advica? 
fmtm. dkS iha (HMctiay of iho task ^maraa wMh iita naad for 
aiaborailon? tluM la. wara olaboraHoot of iho atfvica mora affactivo wttan 
WW laakt ««aro moro dMiculi? 

4. VMiai lorm of advloa wat moat afiacttva? DM iha advica naad to Oa 
alaboraiad wMi axamplat. aod if to. wfiai ton of axamplo waa moti 
affactlva? 

Thata ^suatHofia ara of prfmaiy importaoca tinea iiiay addratt tha wayt m 1«^*ch 
aiMea and aiaLoniont mlgM mHyonco a paraon't talacHon ttralaglat during actual 
proolam toMng^ Tha ofhor two tatkt. tha Aacal and Advica nacoQnltlon tatfct. 
anamM to dalvo mora daapiy Intc wt«at tfia tubfacit laarnad from raadtng tha 
dHtoraM formt of advica. AacaMno tha advica aivd racognHIno acHont that ara 
conalf.ani wfili H taam to bo raatonabia praraoultltat to foOowIno tha advica So 
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thata Italia wart mtanoad to chacli thai «uO)fci« Itarnad anouo^ lo '^ai ihata 
praraquttHaa and to ravaai any diftarancat CMiwtan ina fomit of advica 

Tha raaulu and ditcustlon wM ba praaamad m two chaptars Thit chapiar 
f ocutaa on tho Effldoncy taafc and iraatt aach of tha four kay qutstkmt tbova in 
turn. Tha naxt chapiar praaamt tha raauNa from tha RacaN tatk and ma Advica 
RacognMon laak. aa wasl at toma raauNt that Mmlt tha ganaraNty of tha ftndmgt 

S.t.t. A NoM on Iho Numbor of Subfacit par Tatk 

Tha data raflaci tha tcoraa of o total of tt3 tub|actt. but thata tubiactt did not 
al parform ai ihraa tatkt: 

* Aa daacdbod abova. 4t aub)acip (Via EffOnly group) porformad S4 trlalt 
of Via CMdancy laak vvlihoul doing Via Advico nocognMon tatk at an. 

* For It tublacta ki ma ElfftAdv group, only iho EMdancy tatk data It 
avilabia; aWviigh diay padormod both latka. ihalr Advica Taak data wara 
dvown out aftar a programming orror waa dSacovarad (thay racclvad 
Inoorroct faadback on approxknaiaty 20% of thak trlalt). Tha Efhciancy 
Tatk data for ihata aubKta wara raiainad. and 17 addMonal tubfactt 
wara run on both latka aa raplacamanit 

* WNto 12 tubiacia ki iha l4o Advica group dU podorm tho Adv(ca 
no c og n Won tatk (tta tha Procoduro taction), thak data waa not Inciudad 
ki Via analytit 

* Fkitly. :hraa aub)actt kiadvadandy faHad to complaia iha racoN taet 
•Vpandbt 0 thowt cha total numbor of aub(«ctt «rho complaiad aach tatk at t 
lundSon of kiaiructloAal group and problam Itomorph (Changa or Mova) Tha 
r^amhatlzad aniry for oach tatk la iha nunbar of aub}acta ki tha EHOnly rapNcatlon 
OfC«P 
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5^ Tlw UlUintlon and UtMly o« lh« Advftct: th« EfUclmcy Ta»k * 

Tlw CMelMcy iMk MMMd MM •nam lo tuMdi Mb^Mtt foio««d a tuat«oy 
tontmtm «Mi Mit a^Mca hi ortfar lo IM tfw moat aMdani aoMton to a proWam. 
Sub^acta wart aikad lo dacUa wMtar a propoaad aoaoa '«aa P«t of tha moat 
aWldam-ioMlon. TMr partami w taaa aaaaatad M latma of ttw accuracy and 
apaad ot ihaaa aacMona. fa aadi of aw CNtdanoy taak maaauraa. a 4x2x2x2 
anaiyala of verlanoa (ANOVA^ waa paifonMa avar «ia Mmcaon, Approprlatanaaa. 
OMMly aod flapicatloii fadoit. Tha Chanaa and Uo^ laomorptia wara analyzad 
aaparaialy Md «M ba dtocuatad taparaitly bacauM «ia cat maana poimad to quNa 
dNftrM paaoma tf. bahivlor. Ttia foloarlna diacicaaloa ponataa onir to raauNa from 
dia Ct?#iiaa laomorph. 

TaWa a-t ahowa wttai p araamaga of aia aub)acta' dadaiona wtra corract aa a 
Modon of -aw kiairueaon. / ^ppro p r tata n aaa and Diaouar varlaWaa. TtM data ara 
praaannd taparaialy foraiaeatyirtaladhatopofaia taaia) and Hard iriaia (itia 
IMoai^ Tha taMa Moaiaa dial tuMocia wtra aamaiva ovaral to dMaraneaa m tha 
lypat of Irtaii. Subiaola wara tignNteandy mora aeouraia on Aparoprlata irlala than 
on )nappropi:jia triala; on aia awaragt. aub$acia' dacWona wara :orrac« on 7a% ot 
aia Approprlata trtala but only on a7% of aia m approprta i a tilala. /11.40)-17.4. 
p<.Ot. 8ub|acta wgra alia Handcanl^' mora accurala on Eaay titala (77% oorract). 
dian on Hard triala (MH oorr^ 8t.40)«i7.4. p<.Ot. 

Thara m» no ovaral aflaol of mjaucdon. luoeaadng mat nona of itia m^tructloAal 
manuali lad aMb|acta to parfomi mucii banar ct much worair ovaral than any o( ttia 
othara. Tna lack of an alfact of tnamjcaon lo ?uprlalng. ainca a kvipNaa that no term 
of advloa mfluancad baliavtor o lanMl M nily com.Mrad la dia control group, tha aubHcti 



75 



TABU 5- 

irrlClENCY TASK; 

Parcanc Corract Dtciaiona ta a Function of 
Inatructioo, Appropriatanasn and Difficulty 
Chanfa laoMor^h 

INSnUCTION 

Ho Rula Concapt Task 

Advica Alona ?xupla Bxaapla 

NAfiC. 

.67 .83 -ttO .80 .83 

.74 .63 .59 .86 .71 

.61 .73 .70 .83 

.73 .79 .73 .68 .73 

.65 .58 .58 .70 .63 

.69 .69 .66 .69 



■AST TRIALS 
Appropriata 
loappropriata 

MAtG. 

BAIO T»ALS 
Appropriata 

loappropriata 
HAIG. 



wlio Mw no mMm. TIw mort diliNtd mlyttt btiow •tt«mpi to lOft out ;ust 
«4ioro mMoo had an tfloci tntf wtitro M dMnl. 

5.3. Old SiihiKstM Follow th« Advico? . 

Tho aionil lor wtwihor or M mjb^&eUM Mowod tho acMco wu tho 
ApproprittMMt oMoct: loioialrio ir NMct thouM htvo mMtd tubjodt mio maklno 
Incorrtoi dodiloiit on ttio VMpproprltio Irialt. Tho offoct ol ApproprttionoM rtporiod 
«bo¥i Moo^Mt mat aN iMb|acit paiformad b«iiar wtian ma inala wara Appropdata.** 
Howavar. a alonNlcani imaraoMon bamiaa n ttia muMton and Approprtaianaaa fcctort 
<6[$.40)«4.9. p<.Oi) i uQoaa n that IMa alfact It maMy dua to two tnaiructlonal 
Oraupa. ifia Ma Alona oroup and Concapl Exampla group. Scoraa for tublacta In 
Hia Aula Alona group avaragad about 20 poMa Mghar nvtian trials wara Appropriata 
than wtian ttiay wara Inappropriaia. lor both Eaar Md Hard idala U1t)-2.6. p<.09 
ami <11)«3.f. p<.0t. raapao tM lyy. S!5»^^, acorv^ lor iha Concapl Exampla group 
avaragad ao poima higtia* on Eaty Appropriata taa^v titan on Eaay Inappropriata 
laafca UI1)«2.6. p<.06) and about IS poima Mghar on Hard Appropriata taaka than 
on Hard lna(proprtaia laaka, abhough iha lattar concraat did not raach tignmcanca. 

Tha dWaranca batwaan AftMopriata md Inappropriata trlala tor tha oihar two 
groupa of aubjacta waa amaKar or non^xlatant. Tha No-Advlca group waa laas 
accural • on tha Inappropriata triala. but tha dHfaroncai wara only on tha ordar ol 10 
polnta. and tha contraata wara not ilonNlcani lor aNhar tha Eaay triala or tha tit: ^ 



^hioH lh« m«lA U«r •! A^prapitcMMM H not *»• lo Mty Mitact of iri«| conttrucHwi o« 
• •li e n or Tha imm nur aw e( tokNton a««ii 9^ p«« p^> xi n«« bMpptoptM* ttttf w«r« 'h* 
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Iflala.'' Tha drop-ott m accuracy on tha Inappfoprlata iriaii may simply maan m«t 
aoma tubjactt in tha No Advica group daviaad ttfaiagiat thai wara similar lo tha 
advlca. Surprtalr>oly. tha Taak Example group thowad no »<jnt ol foHowing tha 
advica: ihak acoras wara avtn sllghily uiiy accurata on tha Inappropriata utalt. (An 
axplant^lon for thia raauM wIM bo oKarad balow) 

5.4. Wft$ tho Advico Halpful't 

Evan though thara la avidanca that at laaat aoma aubjacia loliowad tha advica. ii 
turna out that In tha prar«HH axpartmant. it^ advlca waa not vary hajpful Aa iha 
accuracy acoraa m TaWa 5 l auggeai. lh«a waa no ovaraN aovaniaga to aaalng tha 
advlca. Subjacta m tha No Advlca group wara |uat aa accurata (or mora ao) than tha 
aublacta who aaw advlca Tha lack ol an ovaraN advantage for tha advlca would noi 
ba Imporiant H it could ba attrtbutad ^xdualvaly lo tha inappropriata triala (whara 
aubtacta wara daUbaraialy mlalad Into making mlaiakaa) Howavar. It la apparant Irom 
tha data lor tha Appropriata triala that aub|acta who aaw advlca dW not Wantlly tha 
moat alllclar^ aoiutkNi mora ohan than aubjacta without advlca. avan whan that 
aoHttk)c ft«a conalatant with iha advlca. 

n la not aurprlamg ;'iat tha No Advlca group did ao waH on tha Easy triala. ainca 
thaaa triala wara daalgnad to ba aknpla enough that aub)ecta could compute ihe 
aolutkMU on their ovw) What la aurprta^ la that the edvtce felled to improve 
pariormanca on the Herd iriela. for which pertormanca waa low overeU Nevertheleaa. 
aubtecta who aaw advlca waio no more eccurete on the Herd Approprlete triela then 
the aubjecta who aaw no advice. 

**Olh«r iMuM fclto* tuppoft ih« cMm tful •M«cl ol App(opri»ionoM ♦« duo lo i«« Alono •nd 
CwK^ Ciampto gioupt otmI not lh« No-Advkt Qfoup A MptiWo ANOVA «ru p««toim»d oo 
IMfHaoMO dot*, omittlrtfl m« dolo fof th« No Advkt O'oop. Tho moio oftoci oT Appiop«r»ionot« twl 
tho AppfoprlAlOAOM » MoftuAl imoiocdont woio t»oth m tleftiecoAt lf(l.30»-i2 2. p< Ot ond 
fl1.3Q|*ia. p<Ot. iotpoct»vo«v I , 
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Tlw lick ol i gam in aocuracv nUgh: tiM bMO oNmi by • o«ln m jft—6 of 
fitponM. Howcvtr. the r«oGilon Mmc mMturM rtvMlM no OMrc<( sps^ Mtvtntago 
■■•ocHHd wMi foiovdno tfw «Mot. Tibto S*2 e^iom Iho Mrof/O vnount ol tkno 
(in Moondi) Huii tubfactt iponi on tfw Encoding end Plannino ln.ifval, studying tho 
HtmHon and goal ol • Mil. Tim <mo are praaamod aa a hirctlon ol Inatructiori. 

OvoraN. aublacta spam about M aaoonds par irtaL Aa in tha parcam corract 
maaauf, Hiara waa no main aMact ol MrooHon, tell aubfacia* Mmaa wara aanaMva 
10 Wm lypa ot Mai. Thaia waa n maM atfad ol OMIcully; aub)acis vara 14 aaconda 
laaiar on Caay Mala Man Hr^d Mali. /!1,40)-i 111.4, p<.01. Thara waa alao a 
aroalar mam affad ol Appropdaianaaa; aubiada wara • aaoonds faaiar on ApproprtaM 
Mais Man Inappropriaia Mala, >!1.40)«22.2. p<.01. 

Tha ol a main alfad ol maMJCion again s uggsais Mai Mara was no ovaraH 
•dvarv ^9 to studying Me adi^ ComKH ^ mr« f/oup waa m fact tha 
fastaal grAip. laUng about 10 saoonda laaa ^ jtal Man Ma No A<Mca group on 
boM Cauy and Hard Mais. Howavac. ihasa dMarancaa wara not siatisilcally 
slgnW ca n t . FurMannora, Ma Rula Alona group. wWch waa ifia o^-ar group that 
'pparandy f(4ewad 'M adwiea. hMted in ralaHvaly Mm ilmaa. aapadaHy on tr4 hard 
t.iala« 

No acKamaga ol acMca mm a^Mar for Ma sacond raactton Uma *naawra. tha 
OacNon Interval. Tabia 5-3 shuMs iha jvaraga amt^viH ol iVna tn saconds) that 



"im mi iK tritm rMCdM WM w nu fS !• M r«pO(l«tf c¥fct lkn«t lor coittct iMponMt onty 



TABLE S>2 

ErriClENCT TASK: 

Encoding uid PlAnnln| TIm (In s«' "'^s), as a 
function of Instruction, Appropri .tansss and Difficulty 
Chtfift Isoaorph 

INSTRUCTIOH 

No Bula Concapt Task 

Advica Alona Zxsapla Exaapla 

HAHG. 

29.5 25.0 26.6 27.8 

34.6 23.8 31.8 32.2 

32.1 24.* 29.2 

46.3 35. A 42.1 41.9 

60.6 37.7 47.9 48.4 

53.5 36.5 45.0 



l^fit TtlAlLS 

Appropriaca 30. 0 

Inappropriata 1.0.4 

MAKG. 34.2 

HAU) TIIALS 

Appropriata 43.8 

Inappropriata 47.5 

.••HC. 45.7 



flul4»eM look to mako • oorrod dodtlon Tho Ui» aro protomod m • function of 
InMnidlOfi. /Viproprteiontoi and OWIcully. For Ms mttturo. ttisro woro no moln 
olH»^ ol MrucHon. Approprloionttt or OMMculiy.** Ovwoi. aublocti took about 7 
•ooofidt 10 mako • dMWon. WoocHon tknot m iha flufa» Alorio and Concopi 
ExampNi cQnd»*M war* aach about 1.3 aaoonda fMaar tfiaii tfia No Advfea treup. 
but ftm dW ar anooa MM lo raocti MaiMcal aignW ca n c o. 

m a4jm. «• mm conckido from Hw avMonca avaNabhi thai iho advk:o ^^aa not 
nocaaaaiy lo good portormam on iMa ta«k. akica auMacia m tho No Advk:o group 
war* Juai an aucuraia and |uai aa quick k> raap^-^ to AppropiMo idala aa aubfacta 
wfio iHidlad iho advlc«. ObvtouHy «iara la no vNun lo havkig acMco thai la only 
right pMl o< Hio tlma, that dooanl Improva acojracy (oomptrad to . ^ikig no advico) 
whan II la rigN ami twi ligntPcantfy lowara accuracy whan N la wrong. Why didnl 
iha aiMca work b({jr? Ii la not M auoiocia oouW aaaiy Ngura out iho aokMtona 
on Mr own; iho poor parformanca on iha Hard iriala augoaata thai aub)acta naadod 
ba^ ol aoma aoa So tfia probiam taama to Ha aNhar with tha advico krolf or wUh 
Iho aub^cta' abMty /O lo«ow it Tho termor poaalbMty auggaaia ihai ihn aiMca kaoN 
noada to b« changad, iha toiiar that wo havani yot tound iha dghi wry to Iraki 
paopto to tokow tha advica. 

Orm poaalbia probiam wih Iha advtca Naalf la rturt k didnt alwa/» te. 1 unkiuoly 
to ;ho moal aMdam poih. That li. ihara waa okan mora than ono aokilon path for 
a ktal that waa conalaiant wMi ma att-" ^. So whko fti»^^ iho piobC. and (lykig 



#•.01. \tlh Irt l UC i M MMW W M OM W HM Nt A*i4c« Wld Mult Atom arOUpt wMcIt lMI«l 

on AppfOprfaM Matt wtwn kw Mili wwt tMr* M iMltf m ^WM^/ptM* Irlilt wAm Iftr. mi% 
Hw#. 
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T^uiLE 5-3 



EPriCIENCt TASK: 

Dtclslon TiM On stconds), %M a function of 
Instruction, >pprGprl«r «naf k %nd Difficulty 
Ch«n{« If/0«orpb 



INST«UaiON 

No tula Cnncapt Task 

Advlca Alona Exaapla ExaapU 



HARG. 

7.5 3.5 6.3 7.0 6.0 

8.3 7.9 6.9 7.0 7.5 

7.9 ii./ 6.6 7.0 

8.3 6.8 6.5 6.9 7.2 

7.8 6.1 6.8 7.5 7.1 

8. 6 5 6./ ..1 



BAST TUALS 
Approprliita 
Inappropriate 

HAEG. 

BAKJ TEIALS 
Approprlata 

loappropriata 
MA»G. 
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to IM «Mi mom tfOclMi pMh. tubftdt imr* hm ooctalonally i%covtr«d • path ih«t 
mm oowiium «Mh ilw mMo«, linaiura ihM H ivm rnn iha moti •Ificitm path, and 
looM no Mm. Whtn pmtntid imMi m .liilofi. ihoy rMponM on trw 
mil, ipiow ihM th« path iity Htd chottn wm tit ftgM m. Whtn trw trM w«r« 
Appraprttit. that* mblactt wc\itf tM abip to ooatcily rt^tei acilm thai propOMd 
vtoHUhfl lha adwtea. but ihay mKjhi maha iv» UnOJ ol nUaiakat. Thay m*QW 
Inooffad^ accapt actlona Imii tfia InaMdam path Niay had choaan oi Incofractiy 
fa|aoi acHona Irom iha paii Wm wm achialr maat iWc H n i . On via oihar hand, aN 
ihaaa tubiioia nould ba ocnalnaMly noMad ok dia InappfOpdMa irtalt t)acama 
WtoNlno Iha adwica would adi iajd dMm lo lonoia aokdiana dial Watandy vtolatad 
dia 'ana changa' fturtcdon, avan dwugh diaaa aohdlona hanad cm lo ba moai 
aMdani Mthtjuph iMa Imaipfaiadon li comliiafd aMi dia pauacn ol caaMai M would 
ba ddhrtA 10 yti^j II whhoui toMwhiQ what aahidofi padi aids|acia badavad waa iha 
MOM oMolini. d iNa Mafpcaiadon li oonaci* hoMwof* dia.i dia adiflca li no Qood; 
d Mte 10 narrow dio aaarch apaco ol ioludona audldandy lo halp iuoiacta And dia 
ban aohdion. 

Thara li alia dia poaoMdy dial aubfada dM not Mow dia wMca doaaly 
anouQh. TMs poitdidNy «M ba dhcuaiid m aacdon 9.6 balow and in dia naxt 

Evan tf dia advtea li daiannlnad to ba bad atfdca. dia raauNa of dHa axpartmanl 
ara imaroadnQ lor whal diay lal ua ab(ul how paopia uaa a<Vca (goal or bad): how 
haavdy dwy raSy on h and whadiar ddfarani lorma of acMca or dMtaram laaka affact 
dia daoraa o( thM ladanca. 
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SO 

S.5. Okl Task Difficulty Affact RaUanca on Advice? 

Aa rtponad abova. tubjacta wara algrthcanily mofa accuraia Easy inaia than 
on Hafd trtala. and naadad alonmcanUy laaa tima m tha Encoding and Planning 
toitacval lor Eaay mala than Hard Wala. Howavar. OdflCvty <?id not Intaract wlih 
A^proprtaianaaa on any maaaura. making taalc: hardar did not aaam io Incraaaa 
aublada* raManca on tha advfca Aa dia accuracy raauMa m Tatla S t indicatad. 
aub|acia in iha Concapi Exampla and Rula Alona groupa ahowad avfdanca o< 
fodowing dta advica avan on Eaay irlala. whan thay ahould hava b—n abia to 
compma dia aolutlona mamaatvaa Fufdiarmora. diaaa aubfacta ware not mora apt to 
lo«ow d!a advica on tha Hard triala; dia apraad batwaan tha acor«« for Appropriata 
ard inapproprtata tnala waa again about id pomta. 

Ona ndghl ba tampiad to condurla mat Uiaaa aubfacia fodowad tha advica bUndly. 
navar attampUng t» analyza dia problama on tfiair own. Kowevar. thara la lodlract 
* avManca dial diaaa aubfacta raialnad a caiialn dagraa of mdapandanca in psnicutar. 
lodowmg dia advica bdnoly would hava lad aub|acta lo nUaa a«r of iha I. )roprlaia 
irlala* but padormanca on dia lnappropr<ata irtala tmt droppad balow ct\9nc; avan 
on dia Hard trtala. 

Parhapa dia raaaon dwt aubjacta foNowad dia advica to dia aama dagraa lor both 
Caay and Hard tnala la that diaaa Irlala wara nHxad togadiar That ta. iriafa wara 
pr<«aaniad m random ordar and aubjacta may hava lacad a Hard taaH at any point In 
dia axparimam. So d aubfacta racalvad aoma Hard triala aarty m Mia axparlm^nt. 
diay may hava dactdad to uaa tha advica to aolva diam. Onca thay had thought to 
inM dia advica. though, thay may htva atuck to iha aama maihod avar. lor E«ay 
triala. Thta mtarpratatlon can ba taatad by r2uc<arbalanckic tha ordar m which 
aublacia aaa triala of dtffarant lavala of dtfflcutty 



ti 

5.6, OW lh« Form of th« Advlct Aftoct Ptrtormaftct? 

im locMm on iht.dWtftoc#t bttwtw llw aroupt thai iiixM th« 

group. nfMoh iMlM tfw ?Mo Alono oimI Coocopt Cximplo groMpt ohowtd no ligno ol 
MhMino ttw «Mc*. m pMloulv. I oigiw Tt* &cMpl* group mty 

hM miffpraiod tfw txampio •« •« wwortod w^f M M *om lo odopt • 
mrm»wtm m» dWwom from ttw ocMc*. Soconrt. I compor* tfw portomwnco 
ol ttw Conoopi Cjiwnpio and IWo Alono groupi lo too wiMl offw:t iho •xampto nity 
htvo hid on pofformonco. 

SJ.«. Tho eiloci ol tfw TMk Cximplo 

SublMit m iho TMk exMpIo eondMoA ihcwwt no tign ol foio«ln0 mo advlco 
nhto poHomitoio «ho EINuoncy iMfc. 7li« doio praMMod m TaOlo S-t auoQoM 
ihaoo iubtaaa woro ovon ilgMly man acsuraio on mo mappropiloio idaii man tho 
Appropdaio MM. Tiw osplanboni o« iNi bihwtof aoom oapodaiy piaui^'i^ 

t. tuMocii dWnl dr/olo mo ni cm a r y Hnw to •'ortino mrouQh mo Taak 
tjiamplo. Thoy tUrwMd ovor bom mo adl^loa and mo oramplo." 

2. Sublocia adoptod a now airaioay boood on mo ojiampio. tiiWch 
madvartandy locuaod adandon away km mo adJco liaod. 

Aeoordmg lo mo M o>planadon. luMacta dUr:1 Mow mo aA4ca bacauao may 
oouWnl romombor h. Tho Taak Cxamplo waa iha langmiaat form ol advlco. Qlvon 
mo WmttM* Hmo conatraW on raadino ma monual. and noi fcnow^^ moi oWdoncy 
would bo bnpoftam for ma laaka, luNoeia may havo laH mia Mcrmailon waa 



<*^»tfMN««ly. 9mtm Mr <wv« utO OiMiMay $ 9m •Mm«l* m coAjuncMwi ^ 

W« m^tm^imim, ^ tfwM MM ctl en «lMil mcm ii M 9mm» MImmn kM oi MwimMoa 
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ralailvaly Ufa to ignora Tharafora. whiia c>arforinirg tha EHiciancy task thasa 
aubfacta navac cttiad on whaiavar waak manttt raprattntatton of iht advtca (hay 
mighi havo fonnad To antWpata iha datt to ba raponad m Tabia 6 i oaiow. 
tublacta m tha Taak Exampla group actually racaM th^^ advica much worsa than 
aubiacta m iha oihar groupa. 

According lo tha Mcond axplanatton. aubiacii dkmi fmtr)b9r tha advica 
bocauaa may imarpratad ma axampla m an tinaxpactad way. Consaquaniiy. thay 
akhar forgot iha advica or rak)iarpratad k lo conform lo tha axampta Than, durifig 
parlormanca of iha Ertldoncy taak. ihay foMowad a ttratagy batad on thair 
miarprauikm ol tha axampla. UFavra and u*xon (1904) and LtFavra <I9«5) found 
axacdy mia aort ol btmavkw ki thak raaaarch on kioructlona for aoMng anak>gy 
prol4ania. Thay founo that whan varbal kiamjcdont for how to tolva a prob'am Oa.. 
aist) ara cuniradkMd by a taak axampla. paopla land to foikMv ihak kitarpratatkMi of 
tha oxampla. How migM aub)acia havo rakiiarpraiad iha Tai* Exampla wt tha praaani 
axporknoni7 ConaMor agaki ma Taak Exampla ki Flgura 4-3. il comparaa ihrao 
ddfarani aokjttona lo iha problam and ahowa thai tha ona contlatam with tha advica 
raqukaa tha fawaai atapa. Tha moat Ikaiy naw kNarpraitikjn of iha txamp^ la that 
k't alwaya nacaaaary to carry out a ayatamaiic pamiangm comparlaon. iika tha ona 
In tha axampla. Thla kHorpraiadon la quka Jffarani from iha advica Tha advica 
waa knandad aa a thori<ui ao thai aubfacta woukl not hava to computa and 
compara tha aiapa ol al poatlbia paiha. inaidad aub)acti thouM only hava kxAad 
tor pad« thai uaad iha Cnanga or Mova rommanda ki a pank^utar way 

Tha rakHarprataHon axplanatlon la aupportad to a canakt aMatit by Iha 
(HaakMlarky of tha parcani corraci data for tha Taak Exampla group and tha Mo 
Advica group ki TabIa M. U Iha Taak Sxampla group had tknply <gnorad tha advtca 
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tftotfMhc-. fMuNt Of ttiM two oraupt ihouM Hm tmn ouMt timlv. m Imi. 
iw M jpoupt wM aoMiy aocMmit vmnB. but tfw Ta* bMipIt graup MnM lo 
iMf« KcurM* on wm lMPP»opttoio irfoli. TMt nmM it c o w rtnint wNh itw 
prapoMtf ftfMiiprMim: II iw TMk CiMpIt iilb|Mlt rouMnt^ compiMd ol pom 
iMQtfit. iMii tfioy ihoiMnI Hm toon iniM on fl» i wp p>opitiio irfoli. Thort H 
•IM temo MMtnc* iioi ii I wc o w im nt «Mi tfio nMorfrMioii oivIm^- 
To* CwwpH group woo iw oiriy flmp lo cowpmi MuMipli poii ItngNw. tfion ono 
MlgNl «i9oa (.loir foocMn ttMO lo «io Cnoodta0 <rn!j PlMwiog Moivol (ToWo 5-2) to 
M lOMQir tfion ony otfMT iioop. lo iMt Mwlr ttnoo «tro Ml Pw tonQtit.* 

Purthor Mnown «« too mBiniiy lo tfooWo boMoo fto«o m oi^ionooono. 
Om My 10 docMo «» quoiiop MOW to lo fo«*o « crtiwloo lovol of roeol on ol 
PM ot iw lomol tofom alooint toblocio 10 po6fon« P*o ^ N good 

loool of PM o^i Ii Pio iNy. iMii To* iM OoipH toNoolo ahoiAl aho« moro 
oirWoMO Of Mtowlrg tio oPiloo. oHomoPvo noPiod opoiM bo io toko PiMmp* 
oloiid proioooli of oubloMt foodbiQ Pio momioI ontf po ito iolo Q Pio emdoncy took. 
THo pfoioooli ibouM mm wtimmf m$ To* CiMplo oub^cio Ipnoro Pw MM oc 
iMMtior Pioy miorproi b J W i f i o P y Pioii Pw oPior $iib|0Git.<* P Pw rolraofiifOioPon 
I r'n*'""" provoo oorrooi. Pioii b iPi to .'lioro^'^ip lo b w ooPgo U wtoPior iub|o<is 
con to vabwd lo loPoor Pw OfMco oMi o.?4PM took oxomploo or portopt a 
; loibloiPon of look ontf oonoopi i i iiwpl n . 



I9M0: IMM 9m Mute* AtoiiiONA iMk. i* M i'li wu i M ncOm • J. ate c ti m i HK 
<0M» H» puiKM pgHi» nmmm ■»!> HP». li>|l H i upw ■ipMcWy n wl M it 1 m <0»«ct 

«w MMoitL hw #MMi> MOMi iNi • «• rm fnwoit j^kjiKi mo mu m mn m •tfvic*. «r 
litO Mc'Ofu^J i ot w tciy * toy ««flO kMn ckto I* iMir • M m m M 9$m m^m^ 




04 

5 0 2. Tho EHoa of tto CnncopI Exomplo 

Tr« fWo Atooo tnd Concopi Exoif>plo pro^ipo bom thowoo ovkJonco of lottcwino 
mo ocMco lor mo Efttdoncy loik. At shown In Tablo ^1. m« t«ro groups woro 
obom oquoMy ocmiraio: ovoroP Pio R«ilo /Mono group woo corroa on 71 porcsnt of 
mo bM. ond mo Concopi &cinplo group on U porcom. Tho Coocopt Exampio 
l^oup oppoo^ to wort moro quteWy Pion mo Rulo Atono grr d (soo UtM >-2). 
lofcfcig on ovorogo of 12 soconds looo por triol. Howovor. mo dMforonco m rsoctKxi 
iOMO woo only morgbiMy signtflconi (p<.lO) for Hord trtolo. 

Ttoro woi o dPforonco. Pwugh. m sonoHli4iy lo Pio Appropriaionoss fsaor. os 
robodod k! how gulckly sub|ocit workod. Tho Concopi Exompio group ssomod 
OI4MOU0 to mo Approprtitofioot monlpUoPon: Pio ovorogo dWorortco :otwoon fho 
ovoral roocPr:) Pmts for mo Approprlolo ond mopproprtolo irfolo woo only 1 socond 
ki conbooi. mo fMo Aiono group opom on ovorogo of lOS socondo tongor jn mo 
kiopproprtoM Moli mon on PM Appropnolo irlolo. Mom of mio oxtra tfcno csmo m 
mo Cncodkig i Plonc^ig mioivol lor mo Hord Irtols. Tho comrast porformod on mo 
OPIoroncoo botwoon mo iknoo for mo Approprtaio ond kiapproprtato trials was 
SlgnMcont <12)«27. p< 05. 

So. PIO Con^<!pt Exompio oubfocts sponi looo llmo on mo &icodiog i Planning 
hNorvol. oopodoiy on Hord biapproprloto trials. Ai mio pokn. « lo only possibio to 
spocuMo obom ^ mis dPforonco occurrod Ono possibMiy it that mo Concopt 
Exoff^ mkikni20d mo nujitor of obornoilvo soknion poms ma: subjects .^tnsidorod 
wMo tookkig for mo most ofPdoni pom. ki portkMlor. mo Concspi ExannM poopio 
may novor havo consklortd poms Pioi doorfy vtoiaiod mt advfco. ovoo mougn ttoso 
woro ki fod moro offtoism for mo kiapproprtato trials Tho n\M Akxio group may 



hM b«oun 10 conttd#r oih«r ptlht, Mp«d4Mly wtMn th«M itfu fooktd r*a»onably 
•Moltm. m Mt UMpproprtaM Irlatt. TIM •xira Him iTm Ru»» Aim tp*ni dtd not 
iMd ttwm 10 obofidon tho od^; so ttity muti htvo ondod up otthor irusUng iho 
mMco moro ttion Mr owi cticulailonc or gMno up on iho oNomotM •otuUont too 

MOfl. 

Why mighi tht Concopl Cxwiiplo iMvt Mndbiod tublKli from dokig tho tamo 
Mno? Tho Concopl Enomulo givt concroio. ipodllo Moncot of Mh *(oo«r and 
*Hogil' cfwngot <' *Uio m$ ChonQo commond II you hivo a dtomond ond nood 
0 iriMig^ or • pcnugon. AvoM uofrio Cfionoo It you Iwvo o dlvnond and nood a 
hoxagon or nopiagon.') Sooino «w noQadM iniikioio may have mado M aaHor for 
aubfocta lo Moniily violaliona ol Nto mMco (Tannyaon. 1173). Wh^yi aub)acta aaw ma 
prowom aNuadon and ooal. iha^ naQM havo auiomailcaly aai a imil ot wliat ahapaa 
10 oonaldor changino and ruM oul of conaMaradcn any ob|acia that woiM 
nacaaaltata vtofattng tho ad^. Ona svay.io Nnd ouC mora about lha affact of tha 
Coneopi Exampla ivould ba to talia ihMilng-aloud proiooola and aaa twhaihar iha Rula 
Aim group conaidart mora aNafnaMva loluilona or a dWorani tat of aNamaiKaa from 
lha Concopl Exampla group. 

n would ba mtaraadng if dia Concap< Exampla miluancad which solution paiha 
rjblaeia war* wiMng to conaidar. Ai In v>. howavor. dio affact for iha axampla la 
fafrly ntinor. Sub)acta apparmdy dU not naad tha axampla m ordor to fotow tha 
advloa. and having tha axampla did not load lo i lgnm ca nd y faatar raacUon tintaa. 
Thia raauk (or non^aauN) to aurprMng Unca axamplaa hava baan shown rapaatadly to 
aM rula appacadon. Takan aa a whola. tha raauNa auggaat that Concopl Examplaa 
ara not an affacdva form ol aiaboradon for advlca. Tha sirongoai conclusion that 
could ba drawn from lha slmNadiy batwaa n lha Concapl Exampla and Rula Alona 
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groups is that ws ha^t found a sacond. mors compdtHog instancs of sstsciion 
Information, m iha form of advlcs. falling to bansm from siaboratlons Howsvsr. untU 
tha sffacis of iha Task £xampla ars sortsd out. it is too soon to draw such n 
conclusion. It may ba that m ordar to ^aka advantaga of tha advics. subjc its naad 
to usa a workad-out sokitlon (such as a Task Exampla) «s a mooc* Ho^svsr. aa 
suggastad abova. tha Task Exampla In this sxptdmant msy hava baan inadaquataly 
procasaad or miskttarpraiad 

5.7. Thg Effect off th* f^ov* liomorph 

Tha tmm prasantsd abova concarnad subiacia In iha Chsngs isomorph only it 
la now dma to considar tha diffarancaa batwaan tha Changa snd Movs isomorphs 
4 Tha imantkyi of crsstmg iha Mova iaomorph was to vary tha topk: of iha advk:a 

I whla kaaplng aa many of tha task fssturaa constant as posslbls. So tha Mova 

Iaomorph subfw -rsad advlca abcjc tha command and Changa 'iomorph 

aub|K*a raad advlcs about iha Char>ga command. idasNy. tha topk: ni \t\* advica 
ahould hava tiaan kraiavant to tha sffacts of iha advica. Howavsr. ths rssutts for ma 
Elhciancy task wars somawhat diffarant for iha Mova isomorph 

Tabla M shows tha parcantsga of corract dadslons ss o function ol Instruction, 
Approprlatanau and Difficulty. As tha Changa Momorph. subiacts wars ssnsiiiva to 
tha difflculiy of iha trials. $ub)acts' acorss on tha Essy trials wars about 9 points 
highar than on tha Haru triala. /^I.57)»3t8. p< Ot OvsraM. accuracy on 
Approprlaia trials waa sNghfly highar man on inapproprlais trla4. sspaciaiiy for Hard 
trials. Howevar. Approprlatanasa did not prcducs s slgnlfk^snt main stfsct or intsract 
wim any othar varlabla 

Tha rasuha lor lha No Advica and Task Cxan^^a groups ara vary similar to thosa 
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BFriCIINCT TASKi 

farcMt Correct DmIsIqm at a function of 
Inatructloo, Afproprtatwta and Difficulty 
Nova Itoaor?!i 



IMSnUCTIOW 



No Kulo Concapt Talk 

Advlca Alont Ixaapla Ixaapla 



UST TBIALS 
Approprlato 
Inapproprlata 



.62 

.75 



.71 
.71 



.66 .S7 
.72 .85 



.77 
.76 



.7* 



.71 



.69 
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BARO niALS 
Approprlfcta 

Inapproprlata 



.76 
.62 



.64 
.61 



.66 .76 
.58 .69 



.70 
.63 



NAIC. 



.69 



.63 



.61 



.73 



.HI 



ERLC 
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In th« Chan^o Itomofph Howavaf. tha accuracy ol tha Concapi Exampla and Ruia 
Alcoa QfWipi J» tuddamy much kmt than lha olhar Intuucitoo Qfoupt Raliacimo 
tha ralailvaly poor partofmaoca ol thaaa two oroupi. iha injuuction lacior producad a 
slonMlcant mam aHact. f{3.57)-3.4. p<M. Tha Concapi Exampla and Rula Alona 
groupa m lha Mova tvomorph dWarad m anothar way Ifom maif countarparti m lha 
Changt »»omofph Wharaat m lha Changa laonwph lhaaa gfoupi showad tha 
blggaai aHact ol Apprjprtalanaaa. m lha Mova laonwiph lha Concapi Exampla and 
Ru(a Alooa gfoopi attowad Nttia or no drop m accuracy on tha Inappfoprlaia ulait 

Tha raactlon tima mauurea provlda Itttia additional inlOfmatk>n ot iniarati. Tabia 
S-5 ahowa lha avaraoa amount ol tlma (In taconda) thai tublacit tpani In tha 
Encodino and Planning intarval and TaWa 5-8 tJiowa tha avarago amour; oi iima (m 
aaconda) !n tha Dacialon mtanml. Tha data m toih tablaa ara pratantad at a 
function of Instruction. Approprtatanaaa and omiculiy. For both maaaurat. iha only 
lactor thai producad a tignlllcant aHaci wat DItnculiy m lha Encoding and Planning 
Iniaival. aubtactt avaragad about 32 aaconda on Ear* triala at oppotad to 44 
aaconda on Hard ^1.^^-82.8. p< 0'.. m tha Oadalon mtcval. tublactt tpani 
about 5.8 aaconda on Eaay irlala and 7 2 aaconda on Hard iriaia. 81.57)- 19 8. 
p<.01. thua. lha maaturaa thamaalvaa wtra again aanaitlva anough lo pick up ina 
aKpaciad dWarancat among lypat of irlala. m addHlcn. -^rMlo tha llmat for tha No 
Advlca and Taak Exampla groupa Ara comparabia to lha timat lor tha corratponding 
groupj m lha Changa laomorph. tha Concapt Exampio flfoup la no longar latiatt on 
alth^r maaaura. 

WhNa It 't diatufWng that tha two laomorpha did not ylald kJanilcal aNacit ol 
advlca, tha l>ci ol a diftaranc* in parforn.anca lor tha two laomorpht it noi In litall 
too ramarkabia Hayat and Simon (1977) lound that a tubfact't ablU.y to sdva tha 



imCIDICT TASK* 

locodtng ud riaMtaf Ttut (in atcooda). m a 
function of iMtruetion. ArfrofrtatMMaa and Dlttlculty 
n37% laonorHi 



imtUCTIOII 



IUiU Concnpi Tnak 
Advtcn Alooa Ixanpln Ixaapln 



usT mus 

Approrrtatn 31.0 25.7 31.5 36.3 31.1 

InapproprUtn 31.5 29.8 33.7 3*. 32* 

HOG. 31.3 27.1 32.6 35.4 



lAAO TtlALS 

Ap9ropriat« 40.9 36.6 U.l *7.2 U. 

Inapftopriatn 49.» 39.0 **.6 *8.8 *5. 

HUtC. 45.4 37.8 43.4 48.0 
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TABU 5-6 



EFFICIENCY TA5H: 

Decision Tint (in stconds)t as a function of 
Inatruction, Appropriatantss and 0«fficuUy 
Hovt I'-morph 



INSTRUaiON 



EAST TKZAl^ 
Appropriata 
Inappropriate 



BAM) THIAI^ 
ApprA> «iata 

Inappropriatt 



l4o Euit Conctpt Task 

Advica A\ona Exa^pla Bxanpla 



HAAG. 

5.0 4.9 6.4 7.3 5.9 



5.5 4.3 7.2 5.6 5.7 

HARG. 5.3 4.6 6.8 6.5 



5.7 5.8 7.7 8.2 6.9 

6.0 7.3 8.0 8.3 7.4 



HfJlG. 5.9 6.6 7.9 8.3 



94 



fl 

lomm ot Hanoi pfototam virtM «fwniiouily dtpindbig on Itw itomorph. Th«y tv«vt 
found «w mm wMon for mtnr oiitr ttmH of proKHMW. So Hit Importwi quMtion 
!• iihtl <»4ittd dllfortnot bilwion Ch^ 
ft9«4 » !• qulio lni*ti«nQ stm* Ptir of to^^ 

botti Iwiwifplw. Tho nwlor mmmm bot ww lor two iwmorpht wu 

Nio p«formtnct of tfw IMt Mono and Conoom Cmnplo oraupt. •« Cti«»oo 
Itomofpli. ilioto oroupo atiowod tfio biQgoM olM of AppfopiUionoot. bm ihoir worM 
Mcuficy «M not aignnow^' dMorwtt kmrn^lmk Oinipio and No iMMco groupo 
m aw Mov« llomorp^ dio Mo Mono and Concapi Cxampio Qroupt 9hoH^ vMuaMy 
no affoct of AppropdMonoiO. Funhomiofo. «)ay imto mucfi loot accuraia diM mo No 
MMoo and TMk Knmpla ywjpt. H oaama roaaonMo lo attrtbulo M conmnctlon 
of raomit 10 dw aama eauoa: dial dtooa groupo of auNtcia Wkmod or aitompiod to 
.foaow dio acMca, Hoiiia^^ar. wlion oulHicia In dia Mo(« iwi^ 
dta advlca. ihoy unaxpadadly anoouMorod aavwa proWama. 

Undtr dm Marprotadon. dw ddloranta bMwaan dia tmo iMntorphc wat cautad 
Ir/ soma dWoranca in tha MMca or horn tub|aeia carrlad li om. ConcaMWy. tha 
ddtoranca might hava baan cauMd by ao«o flaw m d»a conrtwcdon of tha Mova 
Itomorph probNr;ia (Ha dw daocrlpdon of aM conoirucdon m SaciUm 4.3.3)- H it 
imporiani ttiartforto lo nolo dM dw ddfartnca it condnod maMy ca ttia Concapi 
Cxan^ and Ma Akmo groupo In dio EMclancy tatk. Aa daacribad abova. 
parforiMnca m dia Tttk Cnmpla and No AdM proupa wtt comptrabia m ma iwo 
Itomorpht, Aa wa idfl saa In ma naxi chapM. tub|acit m ma two Itomorpht 
raeaM ma tdvica tQualy wad.Waidltl»taamtt,inma Advica RacoonHkm 
iatli« ovarafl accuracy mm quMa m$s In ma Iwo itom«.pht" Tha fact thti iha 

^WtOM MUM dM dtw Itt M IM MoiioffM. In $ m»t»4 v , tit O^cft gin»*» youo wm 
•MM iftiip to «>• Cli«At« iMiMifa. M «!• iiemm iiMt III tw Mo«« lMme«p*i. 
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otHa^anca it itoittad lo tnt fluit Aiont tnd Conctpi e--mpit ofoups m tht 
Effldancy task tooO««t« mai Iht dWftrtnct btiwaan iht Itomorph.* «tt ctutto Dy 
difftrtnoat m tha t(Mca at N rtltttd to tht EHIclancy tttk tnd not by tht 
trantformttlon of tha proMamt thamtalvat 



• So whtt ttpactt of ma tdvica might htva ctut^d mt difltftoct? Contidtr tQtin 
tha tdvtea for tha two Itoowobt. raproducad batow wkh thak rttptcHvt Conctpt 
Examplat. 



* CHANOe It utuaNy Iha moti tfflcitm command to utt whtnavtr you ctn 
mafca an Ob|tct Into ma thtpa you warn by Ittuing Ml on* commtnd; 
omarwita avoid utlng CHANGE. 

iXAIyir>LC: Uta CHANOE whan you hava t ditmond tnd ntad t tritnoia 
or t pamtgon; you can gal to mti^ of matt thtpat wim tutt ont 
command. Look tor anomar way to toNa lha pfoWam U you ntvt t 
dtamond. but naad t haxagon or t hapltgon, 

* MOVE It utually tha moat affldam command lo uta whtnavai' you ctn 
pm tha Objact imo tha Box you warn by Ittuing |utt ona commtrxJ. 
oUiarwIta avoid uting MOVE, 

EXAMPLE: Uta MOVE whan you htva t diamond m BOX«A tnd natd t 
diamond m althar BOX-B (which It mtWa BOX-A) or m TOP (which 
comtkit 80X*A): you can gat to aldiar of tntta boxtt wim jutt ont 
command. Look for anomar way to tolva tht proWam II you naad a 
diamond In any othtr Box. 



Tha Chtnga tdvica (and atpadaNy tha Concapi Extmpla) it quitt coocrtta and 
dttlt wHh timptt ralttkMitMpt batwaan famWtr gaomttrk: ob|tctt. Thtrt't a ftir 
dagrta of cariamty about which thtpat htva tha raltttonthip tpacltlad in iht tdvlct 
A ditmond It tiwtyt 'ona tkla mora* than a tnangia and *ona sidt itu' thtn t 
pantagon. In comratt. tha Mova a<Mca dtpandt on t ral4tk)nthlp of ioctiion. 
Involving boxtt m vtrylng conllgurttlont. Tha axtmpla involvtt ont hypothtitetl 
conflgurtUon of boxu with particular ntmat. bui thtfa it no canainty m tha Box* 
World dofTtain thtt Box*A will tiwtyt conttin t tmaNar Box-8. So tht conctpt of tn 



obHd being 'oM box awey* <i igw concr«i« «id Im (MM* ifwn m« coocapi ol 
tn ob|ici iMMng 'oiw fiiora tida or orw ftwor aWt.* At a raauM. tr»a Ruia Aiona 
and Conoapi Exami<a aubfaoa in ttm Mova laomurpb may hava lormad a vary 
linpraclia rapraaMHatfon of lha aMea. ^.w fact M ttiair accuracy waa so mucfi 
Ir*^ ttian itia otfiar groupa tu Q Qt m tiai «iay acmaly laM on aoma rapraaantatkm 
of tfia !u*vJea. Tha fact iioy vara aqualy aceuraia on Appioprfata and inapproprtata 
thCs augoaaia ihat wbaiavar rapraaamadon dtay dW toim waa <iuMa dNfaram from 
whai taaa InianCad. 

II abouM ba fioatMa lo laai dw hypodiaa.'i dial dw ddfaranca m rapratamationt 
of dw MMca «aa dua 10 ooncrinnaw. A mom 'ooncrara* Mova laomorph could ba 
.craaiad. Loeadana AdoM ba apacHlad aa aloia in cartain fhad poaMona ratha. than 
ai raladva poaMona in a naadng of bovaa.^ N dia concraianaaa la ma kay. man 
parto rm an ca .m dda now iMmorpb should ba much mora «u» parlormanca fci ma 
Chahoa <aomorph. (Adarnihaly, R mIglM ba poMftIa lo cntzXA a nora abstract 
Ctanoa laomorph In nvhlch ob^aoia talia on aftdraiy aortbuias mstaad of tamHiar 
Qdo ma s rto ahapaa. Than dia parformanca m dia Changa laomorph should bacoma 
mora Hia dia praaam Mova laomorph). 
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Chapter 6 
RESULTS AND DISCUSSION, PART II 



Tlw fl«c«N ani A<Mc« ftacognMon tufct •il«mp« lo 69¥f9 mor« dttpiy Mo 
Mw fub|«ctt iMTiMd Ifom rtidlno «!• dNtortnt lom» of ^iMct R«c«Mno ih« § dvtc» 
•nd- r«co9ii2lno acttont mM art eon«tst«ni «»ilh M Mwn to bt rMiontbl* 
pftrtguitliM 10 foUowlno ilw •<Mc«. So mm iMk» w«f» »rt«nd«d to cntck ihai 
subttdt m« m«w prtr«<)ulMM and to ravr/U any dWarancaa ?>aiwfan ma locms ol 
advlca. 

6.1. R«c«ll Task 

Miar cooip»a«no' ma CWdaocy Task, soblacta «ara atfcaa lo wrMa ahoft answari 
10 mroo quaaiiona (ma auct (luattlona appaar m Figura 4-6) 

6.1.1. KacaM of AiMca 

Sublacti ^ nrJ taao any kum of aOvfca (Rula AkKia. Concapi Eiampla or 
Taak Exampla) «vara aakad lo racal ma advica utaH. 

Two (udgaa Sndapandamly scorad tha racaH anawafa on tha following tnraa po^ot 
acala* 

* No cradH (0 poWita) for no answar or for antwara lhal manttonad noming 
thai was ralavtrt lo how lo usa tha conwnands effklantly 
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' Partial cradli (.5 po*nu) for anawari mat n>aniion»d afflciani usa of 
commanda. capiurinq ma apwi of iha ad^a but omimno or Jnccracity 
aiatkH) tha *M moai ono command' conatralnt. 

• Fu« cradH (t polni) for indwara that corractly aiaiad tha 'at most ona 
c^Mvnand' conairaim. 

Sompta raaponaaa for aach of ihoM ihraa codino 'iatagoriaa ira provkJad in 
AppondU E Tha corralailon batwaan tha ^?o .H-Jgaa' acoraa waa r- 77. fnd 
dtoagretmanta wora raaoNad to muiual aatlafactkxi. 

Tabia 6-1 praianu iha maan raca acoraa at a funcUon of Inawuction and 
laomorph. A 3*2x2 Analytia ol Vartanca (ANOVA) was partormad ovar ma Inatruction. 
laomorph ^nd flaplteatton fadora. Racal ovaral waa no« outtiandlng. with tha maan 
acora about 46. 

Tha form ol matroction ki tha manuala had a aJgnutoant affact on how .wall 
aubjacta r«o»ambafod tha advtea. «2.7n-4 3. p< 05 Subjacti ki tha Concapt 
Exampla and Rula Alona condkiona ramambarad tha ad^a aaout aquaiiy wall, but 
•ubtacta ki ma Taak Exampla group had much worta racaU <27) Aa manilonad 
aarHar. iha poor r* -J ol iha Taak Exampla group tuppona aimar of iwo 
kriarpraiailona: tubKcti ki thia group may ntvar hava procaaaad tha idvk:a wall 
anoogh to racaK ft or tha aumpla may hava lad tham to rakiiarprat ma advtea in 
auch a way that ihay couW not racaN iha orlgkial kiiarpratitton accuraialy Sobjacta 
ki tha Concapi Exampla group, at laui ki tha Chinga itomorph. appaar lo hava 
racaHad ma advk;a bast, but tha contraai baiwaan ihia group and ma Rula Atona 
group waa not significant 

Thara waa no maki affaci of isomorph: aub)acis kt ma Changa and Mova 
laomorpha racakad tha «dvk:a aquaky wall ovarail. Thara waa also no intaraciton of 
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MmcMn fm toomotph. mo ttiouQh tubtMlt m Ct>Mio« iMMnorph mnwd to 
hM tenar rMl iha^ iUblKii m tfw Movt toomorph for m Conc«pi Eumpto 
cofitf^Mftt (.71 .90) and wotm racM h Hm TmIi ExMipto con<lMoft vi .35) 

0km tim wnB mm appMrtd laMy wMk on iMi moMurt. » !• worm 
woonimrtn o wtMtiar any aublaclt wai« abit lo Mow tfia adv«e« on tha Etfldancy 
taak. Tlw avManea tfwi «w ConoafN Cxampla and fMa Mon^ 
adHloa It tfw lact thai itiaaa groupa ahowad dia pradtoiad affaci of Appropriaianm. 
at laaai to dw Ctwnga toomarplL Tlia onlr ddfarwioa baiwaan dia Approprtaia and 
Inapproprtaia Mala waa dtai on dw mappfMM MM* ^ «m n a c aaaa r y to violaia 
dw advlcd 10 Nnd dw moai aMdam aoludon. Furdiarmora. dw racad raMiM ara 
conaiaianiiddi dia Endancy laak raauda: dia oroupa dtal ahowad moat avktanca ot 
folowing dw advico alM oMnad dw Nghaai raeai aooraa. and dta group mat 
•howad no ^iManco of loloidno dw tiO^ had worai racad. TMa con)uncdon of 
raauda mafcaa it laam raaaonabia lo conduda dial aub|acta m m Conrapt Exampla 
and nida Alona groupa wara abia lo foiow dw advtca. daapda diair raladvaly poor 
^iMMdng on tha racad taak. 

M la alao Maraadng to apacuiaia on whadiar dva poor afioMtng of tha advtca in 
ganaral waa dua lo poor racad of K ovaral. d racad of dia advica had b—n 
graaiar. would auhfacta m dia advica condMona havd partormad baitar than aub|acta 
m dia No Advica group? In ordac to Mlracdy aaaaaa dia Importanca d racaN on 
parformanca m dia Effldancy taak. dia accuracy data for dta dwaa advica groupa m 
did Cttanga laonwrph wara raanalyiad uaing dia racaN acoraa aa covariaiaa. 
Howavar. diara waa no aignNlcani adact of /acal on dia accuracy acoroa. atHi 
adfuadng dta acoraa to radact racal did not produca nodcaaMa ddfarancaa ki tha 
cad maana. So aa a group, dia aub|acia m, for axampla. tha ffda Alona group 
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producad a fairly simHar pattarn of raaUts on tha Effldancy task ragardlatt of 
whalhar individual subjactt in tha o^oup latar rtctlvad a high scora or a low scora 
on tha racaN tost. What thlt suggaata Is that tha racaN tast was not a sansiiiva 
anough maaaura of what subjacta got out of raadkni tha advtca. soma sub|tcts who 
ramambarad and actad on tha advica nwy hava acorad poofty o«i tha racaN tasi, 
pamapa bacauaa tha quaatlon (or proba) was too vagua 

6.1 2. RacaN of Examplaa 

S(«)acta who had aaan axan*.plaa In con|unedon wldt tha advica (l a , tha Concapt 
EMmpla and Taak Exampla condMona) wara aakad to racaN tha axa^npia. Racaii of 
tfia axampla waa ovaraN qutta poor. Only i6% of tha aub)acts racaUtd ail or part of 
ma axampla thay had aaan. An addltkxial 22% of tha aub|acts raproducad tha 
ganaral rula for tha advica but not ma apadfic axampla. Naarly a third (27%) ot tha 
•ubiacia wara unaWa lo giva any anawar at aN. and anothar 35% gava answars mat 
dkJnl ralata to tha advica at aN: thay raproducad ma syntactic rulas for tha Changa 
and'Mova commands or axamplaa d dtaaa rulaa. 

Sub)acta wara aakad to anawar thia quaatkM bafora trymg lo racai't tha advica 
Without mia contaxt, thay may hava gottan confuaad about wtiathar tha axampla in 
quaadon waa tha axamplas for tha syntax rulaa mat wara aiao mcludad In tha manual 
or tha axampla for iha advica. in addition. H may hava baan dltiicuit to (rama a 
raaponaa about tha Task Exampla. air)ca It in-^d a spacific diagram and goal 
aUuatlon. 
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Tau 6-1 



RtCm OP ADVICti 

IteM l«c«ii ScorM w • function of 
InainictlMi Mi IsoMrph 



msnucTiQN 



Cottca^t Twk 



HABG. 

laoMrph .)) .71 .19 .48 

Mov* 

IsoMrph .a .SO .3) .44 

MOGINALS .51 .61 .27 



l'?2 
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6 I ? R«uoip«ctt¥« RfcpOft on Sdulion Strategy 

Finally. tut>)acti wara asfcad to ratroipacthfaly dascriba tha st'aiogy they ustd lo 
io»v« lha pfoMama Thara wai quita a btt ol variaiKNi in tna type of response 
•ubf^cta Qtm to trot QueaUon. A numbar o( rtapontaa esMntlaHy recapped the task 
Inasructtona. About 60 raapontea locus«d on «'KUn9 e compleie solution stretegy. 
about haN of thaaa manilonac: counting steps to find the most efficient solution, the 
oUMT haN |usi retarrad to compartng sduilon' to 'i-.a computer's solution' 
Anoifiar (^oup of ebom 30 subjects saannad to tocua on iha individual boxes rether 
(nan on an ovarel sokiilon. Fhay manUonad ifyloo to 'solwa ona box at e time ' 
Of lhaaa. about halt explicitly mentioned auetaglas lor choosing between ihe Chenge 
and Move commands. For exempt*, soma mamionad looking only at neerby objects, 
or uylng to move obfacts balore consldarlng changing shepas. or maning minimal 
shapa changes. Only eight sub)ecta claimed to nave no stretegy apart from guessing 
or Quasslno on trials they thoughi ware hard Tha responses m generel were 
tomawbat vague and ware not analysed beyond mis rough caiagoriz^ikm 

6.2. Advic* Recognition Task 

Tina task essasaad sub|acts' ebMiy to Mga whether or not a solution was 
conalatam with tha advico m tha maimal. Balore performing tfus task, subleus were 
expUcWy ramlndad' of tha advice Aa ki tha EtfkHa. ^ task, subjects were presented 
with a Situation and a goal. Attar thay studied the sHuatkm and the goel. the 
computer propoa#d an action lor achieving part ol the goal Sublacis were told to 
dadda wtiathar or not thia ectk>n wes consistent with the advke. regerdless ol 
whether iha actkMi was part of tha most efficient solution lo the problem See 
Cheptar 4 for a mora complaia description ol this task. 
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9db^* pw<onw>c« wm mmmM both m imm ot 4Ccor«nf r««ctK)n iWnM 
On^kidMo both how ir/ng Uicy look to •noxk »nd p*«» and how loog m«y took lo 
mate • eorrad d«cMoA one* lh« AcHon it«i«intm appMrtd). For ttch dtptodtni 
iMtnve, • 3x4x2x2 ANOVA wM ptrloniMd om ftm m^mictloo. Advtet-Rwonw 
Mtldi. OMIcuily and Itomofph tedOft. 

•.2.1. Accuracy oi u.»Jalom 

Tabia M ihowa parccmaga of corract -dacHlona at a funcilon of Uomorph. 
inamicilon. Advlca^Waponaa Match, and DMcuby. Thadaiaonihaiafttldaoliha 
taWa ara from aublacia m Wm Changa liomorph dMdad Into lha ihraa iiwtructton 
oohdMona. Thadaiaoii*aHQNildaafafort»Mo« Iwwph. Tha data ara 
praaamad Mparaialy lor Caay trtaia (Nw (op of Nia taWa) and Hard irlala (Hm 
bottom). 

Tha datk ahow no ovaral affad of mattucHon: auMacta M ai ttwaa inttructlon 
.^•dWanawafacorraci on about two^hWaoltiaiil^ Thara waa aiao no a«a 
laomorph; aub|acta who wcifcad on tfw Changa and Mova iaomorpha wara aouaHy 
aocuraia warai. Aa m *a WlWancy taak. aub|acia partormad aignWcamty battar on 
Eaay triala than on Hard Iriala, ^^l.29)-li.7. p<Ol. Subjacta* acoraa avaraoad 
iwalM parcamagc poima Mghar «han triaia wara Easy. 

Although thara waa no ovaraN affact of matruciion. axamptaa dW tmprovo 
paclormanca aomawhai. Sub^acta who aaw an axampla (alihaf a Concapt Exampla or 
a Taai Exampla) wara iWk mora accurata than aub^acta who aaw tha advfca without 
alaboraHon hba Rula Alona condMon), 49:^)-2'M. p<.OS. V^ik raauN comraaia with 
lha raauNa ol tha EMc;ancy and Baca taaka. m wNch thara waa UMa dlffi^anca 
baiwaan lha Hula Alona and Concapi Exampla groupa. but both of thaaa groupa 
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TABU 6-2 



AOVICB RECOGNITION TA:".: 

Parcant Corract Uacisiona as a Function of 
Isoaorph, InacrucCion, Hatch and Difaculty 



CBANGI ISOHORPB 



Rula Concave Taak 
Alona Cxaapia Sxaapla 



UST TRIALS 



Uaa-Tas 


.75 


.71 


.79 


.50 


.75 


.83 


Ua«-No 


.34 


.67 


.54 


.60 


.71 


.67 


Don't Uaa-Yas 


.56 


.71 


.71 


.65 


.67 


.92 


Don't Uaa-No 


.79 


.96 


.79 


.50 


.71 


.92 


KARG. 


.66 


.76 


.71 


.56 


.71 


.84 


RO TRIALS 














Ua«-Tas 


.50 


.68 


.67 


.70 


.50 


.56 


Uaa-No 


.42 


.42 


.17 


.40 


.56 


.42 


Don't Uaa-^as 


.50 


.42 


.75 


.50 


.56 


.67 


Don't Usa-Ho 


.75 


.83 


.63 


.60 


.61 


.75 


HARG. 


.54 


.59 


.61 


.55 


.62 


.60 



HOVE ISOKOB 3 



Rula ''oncapt Task 
Alona Exaapla Exaapla 



105 



t03 

dMMd IMm Hit TMk bwnplt QTPUp. Tht mmplt owupt m«y hw« ptrtocmtd 
IMMT «n »w A<Mc« RfcognMofi iMk iMCtuM ai •ubjtctt mf rtmk^ of' iht 
•airiM (and Mr mmplt. N any) bilora comptMlno M and tfw iMtt •xpHcHly 
rtquM oompwlno «w propoMd acdon lo tfw «Mcd, Tt* rtmiodtf «tvt m Totk 
EniM* 9WP oppodunKy and a moiM to procMt (or romiorproi) Hit advteo wS 
Wm mmn^. Slnco Wm Atf^ mcoQiiMon ttji moi« of • dwtificittoo task, 
•ahor kM of OHampia Mpad parfoimanoa. 

Pwfonmnca oa Ma taak taaa ralallMly km. aa tfia margkioia ki TtWa 6-2 
kidtena. Partofinanca ovtcal avaraoad about %m ooiraet. Tha dMtkm of trtala k«o 
aw AiMca Waaponaa Match catagortaa ahowa diat aoma Wnda of irtali wart much 
mora dtMouit aian oihara. nXVim^h P<.01. Tha haat partonMiwa (77% corract) 
cama on tha Ooni Uaa44o trtala. to lhaaa trWa, aublacta wart prooaniod wHh an 
■cdon aiatarwM that vioiaiad tha advtea and tha oorraci raaponaa waa No ((.•.. M 
Mtlon waa not conalatant with tha acMca). Tha worat porlormanca (52H coffoct) 
c«na on tha Uta4lo irwa. to ihaaa trtala. diara la a poailbia ttap that acwavoa a 
pMt «f tha goal and that la con aH u nt whh tha advtea. but iMa ttap la not ma 
aodcn thai tha compmar propoaaa. ao tha corract roaponaa la No 

Tha data ooncair::r.a tha Advlctaatponaa Matd» factor todteafra that tfwaa task 
(MMiraa kiNuanoa how aaar k la la Wanaty tha advlaad tokiiten. it waa rolaUvoiy 
oooy lor Mblacts to rtjoct actlonr that vk)latad iha adwtea. but iiardor lor thorn rtjoct 
•ctlona that dktol ajcpkcMy vMaia tha advtea. but dklnl oiptok H akhar. Stoco 
ihoaa talk faakiraa cut aoroaa toa ApproprtataAnapproprlat«» dknanakm kt tha 
Eiadancy laak. Mbfacta may not hava baan abia to Mcv tha advica waN anough to 
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ld«itlfy tokjtkw ooint conswont with It. This may matn that $ub|acis need mora 
•xpUdt kiitructlona or *lrt(nk>g* ki how to fouow the idvice 

Anoihar roMon why woftf ki tho Advtca Racognkton task may have joen 
rolalMly tow it that tub|actt may htvo cooluMd tho kwtrucitona for tw$ task wlih 
lh« intmidkNia lor tho Etficitocy taak that thoy had akaady complaiad. Although 
moy waro a)4)kckly toW to judga tho proposed actton for conslataiKy without regard 
lor whaihor k lad to tho moat efftoient aokittoo. tubtocis mey not heve been able to 
drop ma offtelaocy c-iterton. Tho eHect ol such •conternkv^km- cen be assessed by 
counterbelanctog the ordar rd the two isks. 

e.2.2. Reaction Tkne 

Tho riarances between the type« of trielt discussad above were no! reftectec m 
Iha reactton iknes 'aWe e-3 shows the everege amoura ol time (In seconds) needed 
to rrtake u correct decls^ on an Advtee Taak triel (the sums ol the times lor me 
Encodkig A Plannk^g end the OecWon kwervalt) The date ere egeln presented es a 
functton of Instructton. Advice Rasponsa »4elch end OIKteulty. T^ie only lector to 
.produce e main eHect wes OtfflcuHy: subjects spent about 25 seconds on an Eesy 
trial end 37 s^«-onda on e Herd trial, 8l.29)«74 5. p<.Oi 

There waa. however, e significant Inatructton x Isomorph kitarectton, f<2.29)«3.6. 
p<Od. and e .Ihreewey instructton x Isonwwph x OlMlcully interaction. 
^^2,29)«10.7.p<.0l. These kiteracttons Indkial* thet the Concept Exanple group 
porformad dIHerently m me Change end l4ova Isomorphs: hi the Chenge isomorph. 
tha Concepi Example group gave the lastest responses, whke in the Mcve isomorph. 
ma Concepi Exemple group geve the stowest responsas. This dilference wes lerger 
lor Hard tasks then lor Easy teska. This resuft may reflect the fact that the Concept 
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TAIU 6-3 



AOVICl itCOGMmON TASKi 

Ovtrtll R«4Cllo« TIm (in s«coiidt)> 
prM«nt«4 M A functloa of ttoaorph, 
Xiutnictl'oa, Nttch tod Difficulty 



aANCi xsoNOtri hovi isonoRra 



RuU Cooctpt Task tult Concept Toak 

Aloot BJuapU IxaapU AloM IXMpU Kmplt 



lA^ nuts 





26.1 


2t.9 


Uso-No 


28.4 


26.2 


Ooa't lte«-T«s 


22.6 


n.2 


OOM't ttM-No 


20.0 


ia.3 


HOC. 


24.3 


21.4 


10 niALS 






UM-TM 


39.1 


2t.2 


Uoo-No 


46.2 


27.1 


Ooo't UiO-TM 


36.7 


30.9 


Don't Uat-No 


36.3 


26.2 



NAM. 39.6 2S.1 



23.6 


31.1 


29.7 


22.4 


26. S 


20.1 


38.6 . 


22.6 


26.3 


21.1 


33.3 


22.0 


29.6 


23.2 


32. S 


22.8 


26.S 


24.1 


33. S 


22.5 


42.6 


32.5 


48.1 


39.1 


31.0 


12. S 


61.0 


38.4 


A9.2 


24.8 


49.8 


25.9 


42.2 


38.1 


54.2 


36.3 


41.3 


27.0 


S3. 3 


34.9 
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Exampio waa nwa concraia in ma Cnanga iwrnorph than m tha Mova isomofpn (saa 
ttia iM$cu»9kift *n lha pfavtoot chapiaf). Tha Taak E*amPl« youps wara prasumabiy 
unaffaciad bacauta ma dlayam provMad axtra tpad(lctty. 

6.3. R8plic8tk)n •fftcts 

' Tha gaoaramy of iha raauHa ol mia a xpartmant It waaHanad by rapWcaUon aHacis 
Two distinct groopa of wb|acw partormad lha anpafhnant. Tha EM^niy RapUcailon 
aublacta (who partofmad lha Effldancy taak but not lha Advica nacofloiiton tatk) wara 
prtmarlly aludanta ai CarnagJa-MaMon. Tha EMAAdy •ubjacia (who partormad both 
taantl wara primarily irom lha Umvawliy ol Ptiifburoh. Tha Rapilcailon lacior was 
hKkidad m an analyaai lof lha EWdancy ano RacaU laaka (AM subjacii who 
parformad lha Advica Racognliion taak wara Irom tha aama Bapilcaiion) in ganaral. 
•ul>|acta m tha Eff^ napUcaitoo wara quickaf and mora accuraia man ma EftAAdv 
tut)lacit. Batow ia i summary of lha rapHcatk)n affacta. 

In tha EWclanc' laak. tub|acta m tha EM-Only flapUcaUon wara mora accurata 
Tbalf icofaa wara ai*Mt 10 polnta NQhor lh»n lha E«»Adv yoop In bom ma Changa 
iMmorph and tha Mova Itonwph (fll1.40). 12.0. p< 01 and ai.57)«4 7. p< 05. 
raapactlvaly) in ma Mova ttomorph. Ihara was alao a algnlflcant mraa way iniaraction 
of initructlon x CHMlculiy x BapUcaiton. fll3.57)«4 7. p<.01. Two Instruction conditions 
(Copcapt Exampla and Task Exampla) saamad to conirlbuta most to this iniaraction. 
Bom groups wara much lass accuraia on Hard trials Ux ma Ell^nly BapHcailon. but 
In lha fc^AAdv RapMcallon. mara was no dllfaranca b«»lwaan Easy and Hard mais lor 
lhasa Instruction groups 

Tha raacilon tima maasuras lor tha Effldancy task also producad soma allacts ol 
rapUcatlon. but only In tha Changa Isomorph. In tha Encoding and Planning Inlarval. 



109 



107 

mm9 m» m tllMi of IIMcaiton- Thm wm • tvM^ imtractlon of 
Mucioii X OMICMlly X RoploMlon fll3.40)-4.2, .p<.0». ood • lourH^oy Woriciloo ol 
Mnidlon » ApproprtilwioM x ONicuKy x NplcMii a3.40).3 3. P< 06. TboM 
imtrMMM mmhio bo duo 10 ono coitdlrtoii. tfio tubfoclo m itio Ot-Oniy flopHcotlon 
WHO ttadlotf tfw Ruio Mono taomidlono. Ttio oMocM of bom OWicuiiy ond 
ApDfopflilonooo »oro iwico M WQ for Mi oroup ttion ofiy oihor group, m tho 
Ooeliton wm^ inoro woo o mom o«oct of noptcoMon. fl(i.40)-7.6. p<.oi. 
SoNoeit m Wm Elf-Only o»up woro 2.3 oooondo lioior mm tubfocto m tho ElfSAdv 
9roi«. Tho nopdcoilon tMlor mo Morodotf «Mi Appropiloionooo. ^i.40).4a 
p«.06. SoNodo m Pw Of-Onlr W oplcillon woro o«ioNy tool on Approprtolo ond 
In^pfopiM irtolo (0.0 ond M tooo.. fOopoOMly). wfiio tfio OtftAdv mbfocto woro 
ibom 0 iocond footof on Wm Appraprloio ^ dton dw Inoppropdoio trM (7.0 vo. 
0.7 ooci). 

Fmoly. on tho roeoi mooftiro. tuMoctt m ooch of tho two ropNcatlooo focoNod 
iho'ad«4oo oquoMy woU: dioro woo no mom oftoct of f^opHcoUon and tNo factor did 
not MoroGi wUh any ottwr fodor. 

Thooo oflocio and mioraollono wookon tho ^^trnm of tho flndlngo tinco thoy 
mgooil Ihoi offocit of advico «wy for dWoroni oroupo of aubloctt or for othor 
unoonMod rooMMO. m Qonorol. Wm pattom o) oflocto MOQMia olmplif that tho EW- 
Ordy group «t$ quIcMr and aioro accuraio than tho Clt&Adv aubtoots. Tho ovoraH 
gpodd and accuracy advaniagoo of tho Bf-Onfy group moy bo duo to tho dWoront 
Mudam prafNoo at CamogMMon and tho umvoraay of PWttburgh. CamoQlo-MoNon 
iiudontt alao ara moro ikoly 10 havo iraMng m problom solving and othor sMllt that 
mIgM ha^ boon rolovoni to ihooa laika. m ordor to account lor thooo oflocta. K wM 
bo nocooaaiy to coNoct dontograpMo Momwtlon on tbOlocto m hiluro ttudlot. 



too 

Including ouch mfornution at SU tcortt. GPA. spatial ro;iSoning abilMy. ma|or flaid 
of atudy. and to on 
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Chapter 7 
CONCLUSION 

7A. limM^tA BM)oraikms m tnttruclloniil T«xtt 

TIN ooti ol M mtiwh wm to IM 04 wliil iiwkM lor • mor« •Ntcttvt 
Mfuoilofiil m for iUi iMrmnQ. Vm ndMontI «Mom on tfw comwN of tucfi 
loM Moumod itwt iMmon bioo« Irom tfoMM oxplmilono ol ovory roiovom poim. 
TIN fMi«rcii of fMor. Clwnwy & Morg«i On prtit) and CwroN (IMS) tuooMtod 
KM iHt !• MM »» CMO. m fMt ll«lor. Owmoy 4 Morotn'a roMMt tuoooMod ihM 
lownort bmm only Irom aliborMlono on pwtojiir lypoo ol Monnailon In 4 
oompmer utoca monuol. Both novteo and •i^ortoncod connNiiir uoors porformod 
MMfct on tfw compmor moro oMdondy M moy tad tmdlod oloborailont ol tho 
oowmo nd oyniM. but oloMraiioni iboiii ttw funcHon ol ita convnondo or wtan 10 
apply tfiam tad no atact on parlormtnca. 

Tta oraaani raaaardi was daalpnad lo aiplora iMa raauli kirttar. it M tnia ital 
alafaOTiilona on 'aalacilon Inlonnailon' tava no tanaM for laamara? Or was ma 
lack of any tanafN dua lo Ma parHcular taaka or ita particular alaboraUona wp tad 
otaaan m ita acpartmani? Tta enawara lo ihcaa quaaiiona ara Imponam bacauta of 
!talr ImpHcailona lor wrMng manuala, N wriiara know to advanca AM alaboratlona on 
aalaction ktformaHon don't talp laamart» but mat alaboratlona on command ayntax 
do, than ttay can alocata ttak alfona accordkigly. On tta oitar hand. M tta 
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tto 

banaftt of laiaction •itboiationi dapandi on ih« lask itan writeis must 00 cataiui 
analyMt of ita unds of '.asiis laarnais mKjhi partotm m ordti to Otcidt wtiemei 
alaboratlona on tta taiacuon inlormailon »• wonhwmit 

In an attampt to Hod out wtt^ttar MlMnk)n Information tanaflli Ifom •itbofalion. i 
dMignad a now t^tk m wbteb caraful lalactton baiwaan command! wai •ssanllal lo 
good porfonttanca. Salaciton Wormattoo wai ttatad at an advlaory fula lor crtooslng 
baiwaan commands In toma manuaH. tha advtea waa unalaboratad (Aula Alona). 
whta kt othari k wai alaboratad wWi ona of two forms of axamplas (Concept 
Exampla or Task Exampla). Examplai wara ctaaan 10 alaborata m advica bacausa 
axamplaa hava oftan provan quka aHactlva for laarnktQ to apply rulat 

Tta raaulU of tta axpartmant auog«M ttat two groupa of «ib|actt. tha subjacii 
Who aiudlad unalaboratad advica (tta Rula Alona group) and ma sub|acti wtio 
ttudlad advk:a alaboraiad wkh a Concapt Exampla dkl (oUow ma advica Th«sa 
aub)acia rakad on tta advica aquaNy strongly, and did to ragardlaaf of wb«mar taiki 
wara aaay or difflcuk. Howavar, following tta advkra ki mii axparimant did not 
lmp.ova aubjacta' parformanca ovar aublacta wta saw no advtea ai aN Tha fauura 
ol tta advki to improva parformanca auggaata aimar itat tta advk;a itialf was 
daftelani or ttat subjacti dki not lafrn how lo apply tta advk:a wall anough. In 
aktar casa. tta axpadmant shada aoma kgM on tta alfactlvanats of dlllarant forms 
of advica and on how wtfHng paopla ara to fo'low tta advica 

To tta axtant that alaborating tta advica wUh an axampla dIJ noi improva 
p«rtormanca slgnlfteanily ovar havkig tta advica alona. tta avkJanca suggaiti thai 
aalacilon hlormatton may raaMy ta a typa of kiformatkKi Itat doain't banafit Irom 
aJaboratkxi. Howavar. tha daia ara not daan anough 10 parmll such a conclusion 
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For m Mfi9. «it Twh Cxtmpto dW «oi bthw« tht »»mi wty «$ 

«!• M ol «!• tubHcts «9io Mw MMM. Tlw TmH EMfiipto tuDlMia may not hav* 
IMM MiouQh Miwilloii 10 ftm atfwlco or mty mty novo rtworproiod H m an 
uMxpooiid mf. Skwo tfw Taak Exampio aipodad to ba tfia moat aNacUva 
form at alaborailon. N ia bnponam lo IwwKga i a wtwi happanad; pwiiapa H tublacti 
had baan abia 10 maka propar uaa of tfia Taafc bampla. mtk partormanca would 
haw baan auparlor 10 any oiiar group. iMludbi^ 

Tlw fact M auMada apparandy Mowad tfia adi^ica avan itwugh H dW not 
<inprova diair parlormanoa ia«i ua aomaddnp •bom how «Mg paopla ara to raly on 
a^. Wa ym% aavarol odiar Meadona to dda ai^drtmani dial paopla raly haavtty 
on adMloa. nm. aiib|acia «ara oonilaiindy ndM by dm ad^ imo mafctoo wrong 
anawara on dia toappropilaia biali. Sacond. auNaat radad on dia advica aqualy 
haavdy onCaaytrtaiaaaonHardidala. TMa dagraa of radanoa on advica la 
toiaraadng aa wal aa alghdy worUwrna. N la Maraadng bacauaa taachara hava 
raportad naadlng apacW aMona to gai tMdama lo amploy ganaral problanvaoMng 
hjurfadea (ag.. Schoanlald. itTf). Parhapa paopla wara mora «Mng to raly on dia 
•dvloa bacauaa d wm ralaiad dNcdy to a apacdto proeadura (U.. Hia Chsr^ or 
Mow command) to a ipaodto domain BoM World). Tha raianca on advica te 
wofflaoma bacauaa wa would »a Mudania to uaa advica ludldoualy. H H poaalbia 
dial wMi mora a»par1anoa. aub)acia would coma lo raly laaa on dia advlca. * to any 
caaa. a laaaon dtal daarly amargaa from tola axpadmam la mat wrMara should taka 
cara whan gMng adi^ca. toat aaama tanatola and haiplui doaoni alwayt 

improva partormanca. Furdtaanora. wrdara should iry to aaaaM how oftan advlco la 
toappropnaia. ainca paopla who fodow dia uMca may aaady ba lad attroy. 
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7.2. Goals for Future Research 

Tha rattarch prosaniad hari points tha way lo luturo studtts on iwo dilltrent 
lavala. tha local laval of thla oxparlmantol psrsdlgm arid tha mora gonoral iavel ot tha 
.contam of kistructkHtil toxts 

First, too rosuHs of tha oxparknant provkJad a numbar of surprlsts and puzzlas 
that baar furihar invastlgaikMn Thaaa Induda- 

* dia apparant unhalplulnass of dia sdvteo to ganaral; 

* tha unaxpaotad bahavlor of tha Task Example subjacts, who bahavad 
unNko tha odtar groupa that saw advlco: « 

* tha unusuul bahavlor of aubfacts to dia Mova isonorph. whoso 
parlonnanca saamad to suffar whan ihay triad to foNcw tha advlco. and 

* dia poor parformanca of subfacis in ganaral on tha RacaH and Advlco 
Aacognltlon tsska. 

Spocdic proposals for Invostlgsttog soma of thass puzzlas wara pra..entad . m 
Cheplara 9 and 6. 

On tha mora ganaral lavtl of rosaarch toto tha conloni of instruction, tharc Is 
also much rtsaorch to ba dona. First, wa obvkNJily can't conciudo Irom this study 
that salacllon toformatlon Is a lypa of k armalton that naads no tlaboraiion Logk:al(y. 
wa wM tmf ba abla to damonstrata dMa fact dtractt,. Whanavar a study shows that 
salacllon alaboratk)na fall *n improva parformtnca H wW ba possibia to ciainr tnst ih« 
study stM amployad tha wrong tasks or tha wrnng »*r*'''rsik>ns. 

Thara ara two ways to braa!; out of this cyda. Ona wsy would ba lo build up a 
targa body of avidanca from studios Hka tha prasant ona which spun a vsriaty ol 
task oomalns and usa tha most plauelbia tasks and aitborstions possibia *2 wa find 
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tfw mm tmM am ti^ vm aoein. N mighi Im fMMfWbto lo GtMcM$ mt 
nUftion MofiMMon dOM noi bMM from claborMkM. Vm Mcond way to br«ak 
Hit eydt woiM Iw le a niof* lhaoraiteal appror*. H wt "wmt tor if»a 
•aka ol aroumaM ttiai paopia doni partoim banar alMr aaaing alaboratHMia about 

aa<ic<B« Wofmaiton. tfian k la MarMtfno lo a* wtv iiay doni and wtiy paopia do ^ 

I 

•aam lo banam from alabof a do na about Urn command ayniaK. H wa can pJopomt 
ttia dlWafancaa m ihaaa typaa ol Momadoo or how paopia maka uaa ol tham. than 
wa may ba abia 10 eonacdy pradtel twhat oihar lypaa of fcdormadon do and do not 
banaM km atabora it on. 

TMa kkNl ol affait raqulraa ktanUlyinQ HonMcani akniarttlaa and dmacancaa 
batwaan kdonnailon lypaa. Tha raaaarcb raportad hara anampiad lo axptoit ona 
aMtaftty baiwaan ayntax kdof w adon and tatacdon kdormaiton: bodi typaa ol 
lniowyi>don fian ba a«praaaad aa ndaa ataia wHat acdona lo partorm ki paidcuiar | 
aMuadona. TNa waa wtiy attmplaa wara cboaan aa iho form of ataboraikm lOr itw 
•dittoa: partiapa axamplaa alwaya Iwlp paopia appir kifonnadon that comaa ki tha 
fonn of a rula. Howavar. dia raaukt ol iMa axpartmam kidteaia thai concapi 
mmpiaa did not haip aub»acia apply dw *<Mct mora affacdwiy. Tha bahavlor of 
dia T«ak Exampla group marda furdtar kwaadgadon on dda account. 

TMa roaaarch alao propoaad a ddfaranco baiwaan aynux kdormaUon and •«ilactk)n 
informadon. Envtoytng dia lormar lypa ol kdonnadoo ta compulaoiy. but tha laiiar la 
dta cfd d o naiy. That la. paopia carawl parlorni any laakt on dia compuiar «Nhout 
knowln« how » lacua t^a oommanda diay lalact corracHy. HoK»avar, paopia can 
ohan hincdoA parfacdy «a wdhom laiacdno dia moai appropririo OMnmand; dviy 
may bd lata amdam. but diay gat dw lob dona. Parhapa alaborattona ara only 
uaalu: for compulaory kdormato. ki any caia. a doaar atudy ol how aubtacu want- 
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•bout ooMng Iha problamt in tha EHJcancy may hUp shad mor« iioht on what 
Mnda o( Normalton may naadad 

In tun. lyiiamatte ratairch on what Jnlocmatton laarnara naad and why thay naad 
H prcndaaa to h^/o ua achlava iha go** ot dU»varlf>q how to wriia mora aHaciiva 
kiaiructlonal laxii. 
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Appendix A 
BOX- VORLD MANUAL 
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Introducnon 



Box Wortd « a compoltr program for manipoiating Simpjj geometr.c 0^.;.c'? mai ire 
c,oniw>9a m eo«M at pH:iufto m th« diagrami btiow Th,$ ma**'.:,, ^.h reacn ,ou now to 
commandt to maw ih« compotar daiaia Ob|«cii. mova ihtm from one bo* to anom«f 
or diaoo* inn mw. so mat you can accompHth goaif i*a uhmg ch. conl.guranon ol 
Ot iacia piciurtd btlow oo tt>a »aft aim iMitrnq it mio iha configuration picturad on iha ngm 
Soma gJn^al faaturai of BocWorW ara dMaiM baMw. Oo iha following pagti you mn 
Hnd Niatructinna for how to cnanga. mova and dalata Ob|tcts 

Typas of Otoiacts. Tr»a Obiacti in ma 8o«.Worid domain consuu of five simpia polygons 
trianglaa. diamondi pantagons ha«a' ni and hapiagona 

Afranaamanls of Boiai. Boiai appaar on tha scraan as ractanguiar ouiimas a Box* 
WOfW arrangamant aiwaya itarii w.m ona vary larga toon namatf TOP TOP can contain up 
to ttiraa Boxaa. aacn ot whicn can contain avan imau#r boxai. 

Idanlirytno Boxas and Obiacls. tn >our commands to tha computar you wiii hava to ratar 
to Bo«ai and Odjacii by nama Oo>ai ara idantifiad by a namt such as TOP or GOX A 
pnmad m iha upper talt4»and cornar of iha box Obiacis have a number tfrom 0 lo 9i 
pnntad msida tham For axampla a triangia vwth iha number j msida u is referred to as 

TRIANGLEa. m oraer to distinguish it from DIAMOND? or TRIANGLES 
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ChaoQing tht Shap« of an Obiact 



YOU c«i UN aw w ~«iGe commind tft -oioo* *• 

can chm^ • pMQon mio • Imraqcm or a diwwa a inwaif Thtr* .s a '.mii on 
^1 Innd of ctiaw can mana -an a aiogit ctiar^ .^ommand. J*' ^ 
w.. ».ay ona •i.^la* To a«. a>aaaiia. cona^lar tha i«i ot ^T^'^'^c^Jl 
afranata aato» aeoorav^ la mwi mtmr "lar t»ai«. •jj"*^ xTt^nf^rS! 

ya- ca« d«aat a diamaaa wm mm . llfTSl^l ^^SL^ 

mmm^ haaanyoaiariiiapa. yoyouWHai^ia iaaua a ^"T^^^^^T^ 
aMfaraacAMayauwtiiiioadaartaka Sa, » cnanga a drtmood inw a 

ha»^ pauia^aaua oaa catpmaml la cHaoga 4 M a pamaaon and anom^ to 
^^mSTrnTt^^ a i^a-aaon. Vlian muilpia CHAMQe commamn. you can changa 
any Obtaci wo any of ma oaiar touf mpaa. OwoMiiy. a wanglo cannoi lurn mio an 
Obtad mil two iNloa and a nopiagon car'ioi turn mio an OOiact wMh aigm aidti 

^ Hopcaaon {7 flidaal 




Hosagon (6 fidt«l 



Par*aaon (5 sidaa) 



Diamond (4 sidM) ; 



Triangio |3 aidaa) 

A CHANGE command ha$ mcaa oana wiwcti mutt bo typad m tho Jouowmg ofdar 
CHANGE INAMC Of OBJCCT| tTYPE OF CHANGEI 

Tha M part ta CHANGE, itia nama oJ iiio command. Tho sacond part >a ina n^ma ol ma 
ObMCt audi aa PENTAGON 1 Tha iftird pan la iha duaciion ol tho ctianga typo atihar 
MOAC-SiOeS 10 got a inapa *im ono mora udo ihan tna OOiaci has now or FEWEB- 
SIOCS 10 goi a shape MHh ono tawaf aidoa To Imiin iiaumg iha command to tna 
compmor. pfou tho RETURN kay t 

fXAMPtf 

Tho Mowing command takaa PCNTAOONI and changaa it mto a diamond iby maKing n 
naya FEWER SIDES) 

CHANGE PENTAGONI FEWERSIOES 



Moving an Obiecl to Another Bo« 



YOU cw M» in. MOVE commind lo pul «n OI)|.cl -mo l o.lle.«ni Bo. mo.v.ouai ^nove* 
k^io cro«m, in. .do. o( only on. 80. Tn.l m„ns ma. .v.m a 5,r,,., MOvE 
cltm^iOU CMWty mOvTan 00|.CI «.lo .n. n..l ..rg., or ne.. sma,..r 00. /or 
SS^^WOM in. Ot...C. ,ou w.m .0 mov. .. PENTAGON. -n=cn ^ns.d. BOX A By 
S^on^MOvE conw-and. you c«, m,tm. mov. .n. OOjje. down .n.o BO^B • sm..i.r 
bMMd. eOX.A Of nw. rt up .n.0 TOP coo.»n. BOXA To mov. PENTAGON. .n.o 
m 0«* 00.. you. would t«v. .0 *»u. . l.r«. ol MOVE comm,ndl on. (or ..cn bo. 
!Z.r^Lir««r«ould niv. .o mom so. W mov. PENTAGON. 10 BOX.C you *ou.d 
:^JS!1JZ>T^<l^^^l to ^^P .no ."o.n.r .0 mov. from TOP .0 BOX-C Win 
muHipl. MOVE comm»noj. you cn mov. »ny Ob|«:. mio »ny 00. on in. icr«.n 







c 











FORMAT 

A MOVE command nas ihraa pans wnich mus. ba lypad .n me foiio^>«ng order 
MOVE {NAME OF OeJECTI (DESTINATION! 

Tha firsi part is MOVE tha nama ot iha command Tha second pan .s me name of tne 
Obiact such aa PENTAGONI Tha ihird pan 's iha nama of me oox mat /ou .vam lo 
mova Iha Obiact lo such aa BOX-e To imish issuing tna commano to me computer press 
tha RETURN kay H you typed a dasnnaiton mat -s loo 'lar away .tnai /ou ^oixHi 
nava to crosa tha edge ot mora than ona ook to get tnerei tne computer iwui respond 
'Oaaimaiion loo lar ' and /oir woi have lo tssua a naw MOvE command 

FV^MPLE 

Tha ro8o*tng command takes PENTAGON i and puis »! mto 80x 8 
MOVE PENTAGON! BOX-B 
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0«l«ting an Obi«ct 

YOU can tfM an OtfM from m« tcrttn «s«>fl OELETE conunand Cnce /Ou J 
an 06^. m canfwi dnng h oack 

TN PeUT« connnand hat two parts 1^ muii bt auppM in 'oHowng ordtr 
OCim (NAME OF OftlCCTI 

Tba llrfll pirt i« OCLETE. iha wma ol iha conwaiiO Mccnd part .t tha nama o« tha 
ObHci you ««iN M tfolMa. audi aa PCNTAGONi 

DUMHM 

Tha foaowiao eoowand araaaa PeMTAGONi from tha Bo»-Wortcl: 
OCLETC PENTAGON! 
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Appendix B 
BOX-WORLD TASKS 
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CtwnQt liomofpte. 



> II No bMuM Pw iePM propom • wty le iho prowwn. 
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Box-World Trial (B-4) 
Change Isomorph 
Easy, Appropriate, Use 



TOP 



am- A 


MM-C 


A ^ 
















A 





Goal Box-A should contain two cri«sj«i only, and Box- B 
should contain one f entagon only 



Action Move tnangle-4 to Box-A 

Most efficient solution. 

Change diannond-3 into a triangle — I step 
Move pentagon- 1 to Box-B — 2 steps 

Efficiency Task response No 
Advice Recognition response. No 
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OmnofB Itomorpii 

C-T If • Odul u.^ problMi tmmm »om wtm aiMhir htpiNOO m 
.ai4ot i*^ i« 10 ify to acWt^ *M goal IV ?^ 
Sindl^ btciuio di^iM mon 10 0 hoptoQon lo pod o( 

M moM iliciim aoMloft. 
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Box-World Trial (c-7) 
Change I somorph 

Easy, Inappropriate, Don't Use 



TOP 




Goal. Box-B should contain two diamonds and two 
heptagons only 

Action. Change pentagon-4 into c heptagon 



Most efficient solution 

Change pentagon-4 into a heptagon 2 steps 
(iovp diamond- 1 to Box-B 1 step 

Efficiency Task response Yes 
Advice Recognition response No 
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ClIiilQt ItQHIOfpH 

Hird. AppraprM. Oool Um 
M It • Ooiil *Uit r««tMm bicnni yoy tMAt anoihtr diiiiioiKl H> »o«-A iwd tfw 

iho «Moo li ippfoprtoio. Tho iMM tlicitiii o»tfrf toMlon toNtt ttiol Mbgoal by 
moMlno in iio tfimond irom 6ox-». 
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Box-World Trial (E-6) 
Change Isomorph 
Hard, Appropriate. Don't Use 



TOT 




0 


^0 



Goal Box-A should contain two diamonds only, and 
Box-C should contain one pentagon and one hepiagon 
only 

Action. Change hexagon-2 into a diamond 



host efficient solution. 

Move diamond- 3 to Box- A 
Move hexagon- 2 toBox-C 
Change hexagon-2 into a pentagon 
Change hexagon-5 into a heptagon 

Efficiency Task response No 
Advice Recognition response No 



1 step 

2 steps 
I step 

I step 



•OK WOfW TfM (619) 

CtMAQ* iMmorpH 
Htrd, iMpproTftiit. Um 

It • UM probtom bmuM you wwn •noiNr dtomond m BoxA and ihtf • to • 
pMQon m BOK-A ihtt can tM chMQtd Mo a dtamond In M< ona atap. m tMa 
coaa. mo atMca la mappraprtaia - .nora aMdam lo nwa m iha dtomond from 
io«4. 



Box-World Trial (e-i5) 

Change Isornorph 
Hard, Inopprc priate. Use 



TOP 


aox-D 


6 






M)C-<C 






80x-a 













Goal Top should contain one hexagon only, Box-A 
should contain two diamonds only end Box-C should 
contain one pentagon and one heptagon only 



Action: Move pentagon-3 to Box-C. 

Most efficient solution 

Move pentagon-3 to Box-C 2 sUps 

Move diamond- 1 toBox-A I sf.ep 

Move heptagon-4 to Box-C I step 

Move hexagon-5 to Top 1 step 

Efficiency Task response Yes 
Advice Recognition response No 
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ATr^endix C 
BOX-WORLD TASKS ~ MOVE ISOMORPHS 
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Box-World TrM (B-4) 
IMm Itomorpit 

It • Um pf oMtw ^9emm you warn two htMOont Hi Top. and ihoro t a 
hmoon m Bok-A Bwt you cm mow lo Top vriiti mm Hop. T?w corroct iv^oponto is 
No MtuM Hit Bdloii p r opoooo • dWorani way to to^w «ia proWom. cuai^olno ^ 
Mangla in Tap lo a liaMOon. 
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Box-World Trial (B-4) 

Move Isomorph 
Easy, Appropriate, Use 



TOP 

♦ A 






MM- A 









Goal Top should contain two hexagons, annong other 
objects, Box- A should be ennpty, and Box- r should 
contain one heptagon, among other objects 

Action Change triangle- 4 mto a hexagon 

Most efficient solution 

Move hexagon-3 to Top 1 step 

Change pentagon- 1 into a heptagon — 2 steps 

Efficiency Task response No 
Advice Recognition response No 
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Box WOfW TrM (C-7) 

M ow iNHMVpll 

City. intpprapiM. Oofil UM 



&7 It • 0«i1 Um prMMi bMuM ypu 
itfwiM Ml 10 try to mNm M OOil 



MM MOtfMT <«WIIOIKl kl BOV^. but !»>• 

toy movmo tfw dfomond from Top. tfl tMo 
fMMfi0 tfw Otomond from Top lo ptn ol 
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Box-World Trial (C-7) 
Move Isomorph 
Easy. Inappropriate. Don't Use 



for 



•OX-A 










■OX-C 





Goal Tod should be empty, Box-A should contain two 
diamonds among other objects, and Box-C snould 
contain two diamonds among other objects 



Action Move d;amond-4 to Box-C 

Most efficient solution 

Move diamoiv -4 to Box-C 2 steps 

Change triangle- 1 into a diamond I ^tep 

Efficiency Task response Yes 
Advic^j Recognition response No 
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Mom r^omorph 



* AM Ml iQ «v 10 tcMivt MM ooil tor In from Top. m 

mHIqmI by olitfiglnQ.irtin0lo4 km • dHw wn d. 
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Box-World Trial (E-6) 
Move Isomorph 
Hard, Appropriate. Don't Use 



^0 







▲ 






■ax*c 





Goal: Top should be ornpty and Box-A should contain 
one hexagon annong other objects, Box-B should contain 
one hexagon among other objects and Box-C shO' i*d 
contain two diamonds among other objects 

Action: Move diamond-2 to Box-C 

Most efficient solution: 

Change triangle-3 into a diamond I step 

Change diamond-3 into a hexagon 2 steps 

Move hexagon-2 to Box-B i step 

Movehexagon-5 to Box-A 1 st^p 

Efficiency Task response No 
Advice Recognition response No 
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Mowi Itofnofpti 
Hvd. biippropiMt. UM 

rtS to i UM probtom tmemm you tMM ^t^f^r^^ '*thJ 

dtoiiwid to SoM^ ihoi con bo ipwo^ 10 •0M<; iMih Ml 

mMm to mopproprtoio - H'o moro oUctom lo cHongo irtoogto-i • dtomood. 



Box-World Trial (E-is) 

Move laomorph 
Hard, inoppropriote. Use 













■ox-c 











Goal: Top should contain one pentagon among other 
objects, Box-A should contain one hexagon among 
other objects, Box-B should contain one hexagon 
among other objects and Box-C should contain two 
diamonds among other objects 
Action- Change diamond-3 into a hexagon 

Most efficient solution 

Change diamond-3 into a hexagon 2 steps 

Change triangle- 1 into a diamond I step 

Change pentagon-4 into a hexagon 1 step 

Change diamond-5 into a pentagon I step 

Efficiency Task response Yes 
Advice Recognition response No 
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APPENDIX 0 



Appendix D 

DISTRIBUPON OF SUBJECTS 
AMONG CONDITIONS 



Distribution of Subjects aaong Conditions for 
Recall of Advice, Advice Recognition and Efficiency Tasks 



CHANGE ISOHORPH 



Mo Rule Concpt Task 
Advice Alone Eg Eg 



HOVE ISOHORPH 



Ko Rule Concpt Task 
Advice Alone Eg Eg 



RECAU OF 
ADVICE 

ADVICE 

lECOGNITION 

TASK 



0 

(0) 



0 

(0) 



It 

(5) 



6 

(0) 



12 It 

(6) (5) 



6 6 

(0) (0) 



0 

(0) 



17 17 15 
(6) (6) (5) 



(0) (0) (0) (0) 



EFFICIEMCY 
TASK 



12 

(6) 



12 
(6) 



12 12 

(6) (^) 



15 17 17 16 
(6) (6) (6) (6) 



' The figures In parentheser. represent the nueber of these subjects 
who Mere in the Eff-Only Replication group. 
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Appendix E 
SAMPLE RECALL RESPONSES 



«M«to n mant m tot Itocal oi AiMm 



• O0fi*l rMMMbic. 

• t do Ml fMl lhai Hit iNittiiil ti^liM tpiwi lo m co«nmindi. Th«y 
only MM wtMi co wmowJi dU and Mr gyniw. 

• You 0011 movo oMmH ono boK ol o ttno. You con dioftgo obfocto by 
oddma or dtiiMnp tidoo ono ai • Nmo. /ou con doloto objodo: onco 
diHHd, tfioy coni roium. 

• Uoo oooimondt whon dioy lood 10 •» moil o«Ww»i wty of ocWovlng iho 
gool. 

• CouM dw numbor ol ilopo InvolMd to totocdno ono urotogy and 
oonvoro dMt wdh dw OMmbor ol iitpo imoMd m ootocttng dio odm. 
Qmooo dw tirMOdy dMi would * lood you lo mo 0(»«l «^ 

• QMngo ddnoi t bid ^1 movd diom much. 

• Tbd monuol dwm wm boilor noi so chor^ Udoo unlott nocoMOiy 
booouoo d look up MO mony movoo. 

• Uoo 'movo' only d H roMdM In tooo tiopi dwn cbonging dio numbor ol 

glOOO. 

• Uoo dw obonQO oommond oi Mdo m poMlWo. I.O.. onh; wbon d would 
tolio fowor movoo lo chongo an ob|icl dian lo movo M. 

• Uoo cnanQO command only «hon d to n o c o m iy lo mot dto (oaai numbor 
ol commando. 

Woo a o ni oo mssA U Ut 
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It tuggttttd to uta iha chinot conmitnd whtn a obitct naadt to be 
changad by only o(«a $k3a And to mova ob|tct« Uom box to bo« v*h»n 
oacaaaary 

tf tna numbar of tidat to ba maaatad oi dacraastd it mora than ono. 
And anoihar wiy of solving tha problam 

If you hava to movo thru mora lHan ona box. doo t u$a mpva command 

Uta Iha 'movo* command irirttan only ona movo was nacasaary. 

Tha aAHca aald not to uta tha CHANGE command to go from ono thapa 
lo anoihar which wat tavaral ttapt away It taW that a mora alficitni 
way could uauaNy ba found 
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Or. Thonas H. Duffy 


Boon 4145 


400 Naryland Avenue, SU 


Coanunications Design Center 


Washington, DC 20202 


Carnegie-Hellon University 


Schenley Park 


CTB/HcGrav Hill Library 


Pittsburgh, PA I'^IZ 


2500 Garden Road 




Honterey, CA 93940 


Dr. Richsrd Duran 


*Jniversity of California 




Santa Baihara, CA 93106 
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••rktra Btton 
NtliUry Uttcalor's 
tetowrc« Ntlvork 
IiiUrAM?lc« Icmrcli Aatoclattt 
ISSS miMn tlv^ 
Arlliif Ion, U 22209 

Uvar4 t. Moms 

aum 11301' 

Nftval Air Statico 
Corpus ChrUtl, TX 70419 

Dr. Jolw tills 

Navy NraoMMl UD CmUr 

San DI«to* CA 92252 

Dr. Jaf fray tlaaa 
llAlvarally of California* 

San Olafo 
DoHrtM"^ of Llncuislics, C-000 
U Jolla» a 92093 

Dr. Rlcliara tltlar 
Oopuly Aaslstnni Sacralary 
of Iko Navy (Naopovar) 
OASN (HMA) 
Ooparlaonl of tlw Navy 
VaaklnftOA, DC 20350-1000 

Dr. Susnn Mrataoo 
Unlvaraily of Kansas 
rnycbology Der*rtMnt 
U^tmicm, U M04S 

Dr. Kan4y lof la 
DopartMSt of rsychology 
Unlvaraity of Soulh Carolina 
Colunbln, 8C 29206 

Dr. VllUan lMl«in 
Unlvaraity of Vlsconsln 
V. J. iroi^an rsycholocy lldg. 
1202 «. Johnson Strsat 
Madison, tfl 53706 

BRIC Paclllty-Acqulsltlons 
4833 RUf by AvaQua 
Bothtsda, NO 200U 



Dr. Bdvard laty 

Dapartaant of Iducatlon, OKKI 

iooa 7170 

1200 19tli St., NV 

ttaslilngton, DC 2020S 

Dr. raul Paltov^di 
SotftiMta Illinois UnlvOTslty 
School of Nadldna 
M2cal Idttcatlon Dapartaant 
r.O. lox 392i 
Spring f laid, IL 42701 

Nr. Vallaca ravrsalg 
Iducatloaal Tachnology 
iclt Btranak ( Navaan 
10 NoMltoa St. 
Caahrldga, NA 0223S 

Dr. Gorhard Plschar 
Unlvaraity of Colorado 
Dapartaant of Conputar Sclanca 
■ouldor, 00 10309 

Mr. Linda ?lovar 
Carnagla-Nallon Unlvaraity 
Dapartaant of inglish 
rittshurgh, PA 15213 

Dr. Carl 1. Pradarlksan 
NcCill Unlvaraity 
3700 NcTavlah Stroot 
Nootraal, QaaUc I3A 1Y2 
CANADA 

Dr. John R. f radar Iksan 
•olt loraaafc ( Navaan 
SO Hoaltoa Straat 
Coahrldga, NA 0213S 

Dr. R, tdvard Oalaalaan 

sufartaaot of Psychology 
Ijolvarslty of California 
Us Angalas, CA 9<^'>' 

Dr. Arthur N. Clonharg 
Unlvaraity of ttisconsln 
«. J. irogdan Psychology ildg. 
1202 «. Johnson Straat 
Nadlaon, VI 53706 
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Dr. Saa Glucksbcrg 
Princeton University 
Dapartaant of Psychology 
Green Nail 

Princeton, NJ 08S40 

Of, Joseph Goguen 
Coaputer Science Laboratory 
SR| International 
333 Ravensvood Avenue 
Nenlo Park, CA 9A02S 

Dr. Susan Goldaan 
Unlvaraity of California 
Santa Barbara, CA 93106 

Dr. Shcrrie Gott 
AFBRt/MOOJ 

Brooks AFB, TX 782 3S 

Dr. Richard H. Granger 
Dapartaant of Conputer Science 
Unlvaraity of California, Irvine 
Irvine, CA 92717 

Dr. Wayne Gray 
Amy Research Institute 
SOOl ^isanhover Avenue 
Alexandria, VA 22333 

Dr. Henry H. Halff 
Balff Resources, Inc. 
4918 33rd Road, Notth 
Arlington, VA 22207 

Dr. Nancy F. Halff 
Halff Rasources, Inc. 
4918 33rd Road, North 
Arlington, \'A 22207 

Dr. Ronald K. Hanbleton 

Prof, of Education 4 Psychology 

University of Massdchusetts 

at Anherst 
Hills House 
Antierst, HA 01003 

Dr. Cheryl Haa«l 

ntec 

Orlando. FL 32813 



Dr. Ray Hannapel 
Scientific and Engineering 
Personnal and Education 
National Science Foundation 
Wash!7«gton, DC ZObbO 

Hs, Carol S. Hatgan 
Manager 

Instructional Videodisc Group 
HuaRRO 

1100 S. Uashingtoti 
Alexandria, VA 22314 

Mr. WiUiaa Hartung 
PEAK Product Manager 
Amy Research Institute 
5001 Bisanhover Avenue 
Alexandria, VA 22333 

Dr. Wayna Harvey 
SRI Intarnational 
333 Ravensvood Ave. 
Roon B-S324 
Menlo Park, CA 94025 

Prof. John R. Hayes 
Carnagia-Mallon University 
Oepartacnt of Psychology 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Joan I. Heller 
505 Haddon Road 
Oakland, CA 94606 

Dr. Malisaa Holland 

Amy Research Institute for the 

Bahavioral and Social Sciences 
5001 Eisanhovar Avanua 
Alaxandria, VA 22333 

Dr. Claude Jjnvicr 

DirecCeu c:S<ADE 

Universitt:' du Quebec a Montreal 

Montreal, Quebec H3C 3P8 

CANADA 

COL Oennia V. Jarvi 
Conaander 

APHRL 

Brooks AFB, TX ^8235-3601 
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ltorf«r«t J«roM 

c/o Dr. P«Ur ChandUr 

■ov« 

SlWtM 

umno RmGooN 

Dr. Jo*%fh I. Johnson 
AstUti|nt Otan for 
Cra4wict Studltt 
CoU«f« of SclMct and lUtbtMlics 
Milvtrtlty of South Carolina 
ColiMblat SC 2920e 

Col. OoalnlqiM Joualln dt Moray 
Itat-Najor dt lUrata dt Ttrrt 
Ctntrt da Rtlationa Biaalntt 
3 Avtmit Octavt Crtard 
TMOT^farU 

Dr. Marctl Jiiat 
Camtflt-lltllon University 
OtiMrtMiit of Psychology 
Sclitnlty Park 
Pittsburgh, PA 15113 

Dr. Richard Ktm 
Anqr lastarrJi Instltutt 
5001 littnho/tr Avtnua 
AltxaM^.la, VA 22333 

Dr. Oarld Marat 
Unlvarslty af Michigan 
fachnlcal Comm I ration 
CoUtt« of laflnaarlng 
1223 I* ■ailnatring iulliSlng 
Ann Arhor» MI 41109 

Dr. Patar Klacald 
Training AMlysIs 

4 Ivaluatloo Group 
DaHrtMMK of'tha Navy 
Orlando* PL 32«l3 

Dr. Valtar RIntsch 
Oapartatnt of Psychology 
Dnlvarslty of Colorado 
Caapua iox 345 
Bouldar, CO 10302 



Dr. Oarld Klahr 
Carnagla-Nallon Uolvsrslty 
Oapar^MAt of Psychology 
Schanlay Park 
Pittsburgh* PA 15213 

Dr. Nasia Knarr 
Program Naaagar 
Training tasaarch Division 

gyigHO 

1100 8. Vas»..agton 
Altxandrla» fA 22314 

Dr. Janat L. Kolodnar 
Gaorgia Inatktuta of Tachnology 
School of laforwtlon 
4 Coaputar Sclanca 
Atlanta* GA 30332 

N. Dlaaa Langs ton 
Coaaunlcatlona Daslgn Canter 
Caroagla-Nallon Unlvarsity 
Schanlay Park 
Pittsburgh* PA 15213 

Dr. Itobart Uvlar 
Inforaatlon Sclancas* Pit 
GTB Labors tori as* Inc. 
40 Sylvan Scad 
Valthaa* MA 02254 

Dr. Alan M. Usgold 
Laamlng 140 Cantar 
Unlvarsity of Pittsburgh 
Pittsburgh* PA 15260 

Dr. Alan Laahnar 
Dapttty Division Dlractor 
lahavloral and Ntural Sclaacas 
Natlanal Sclaofia foundation 
1800 G Straac 
'tsshlngton* DC 20SS0 

Dr. Clayton Levis 
Unlvarsity of Colorado 
Dap^rtoaat of Conputar Sclanca 
Caapus Sox 430 
louldar* CD 80309 

Dr. Charlotta Linda 
SHI Intarnatlooal 
333 lavansvood Avanua 
Manlo Park* CA 94025 
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Or. Marcla C. I.inii 
Lawrence Hall of Science 
University of California 
Berkeley, CA 94720 

Dr. Viniaa L. Haley 
Chief of Naval Education 

and Training 
Naval Air Station 
P;ensacoU, PL 32M>8 

Dr.. Nanton H. Hatthevs 
Dcpartacnt of Coaputer Science 
University of South Carolina 
Colunbla, SC 29208 

Or. Richard £. Hayer 
Dcpartacnt of Psychology 
Unlvarsity of California 
Santa Barbara, CA 93106 

Dr. Jaacs HcBrlde 
Psychological Corporation 
c/o ilarc4«urt, Brace, 

Javanovlch Inc. 
1250 VfSt 6th Street 
San Diego, CA 92101 

Dr. Joe McLachlan 

Navy Personnel R40 Center 

San Dlago, CA 92152 

Dr. Jaaes NcMlchael 
Assistant for HPT Research, 

Developncnt, and Studies 

NAVOP 0187 
Washington, DC 20370 

Dr. Barbara Ncan^ 
Hunan Rssourcss 

Sasaarch Organization 
1100 South Washington 
Alaxandrla* VA 22314 

Prof. Jacques Hehler 
Laboratoire de 
Psychologle 
54, bvd. Raspall 
1^-75006 Paris 
PRAHCE 



Or. 'Arthur Helaed 

L S. Dcpartacnt of EdiR«.*toi) 

724 Brovn 

Vashlngton, DC 20208 

Dr. George A. HUler 
Dcpartacnt of Psychology 
Green Hall 

Princeton University 
Pr'iiceton, HJ 08540 

Dr. Unce A. Hlllcr 
IBH Thoaas J. Watson 

Research Center 
P.O. Box 218 

Yorktovn Heights, NY 10598 

Dr. Lynn Hlssclt . 
HON- 222 

Control Data Corporation 
Box 0 

Hlnn< polls, HN 55440 

Dr. Andrew R. Holnar 
Scientific and Engineering 
Parsonnal and Education 
National Science Foundation 
Washington, DC 20550 

Dr. V Ulan Hontague 

HPRDC Code 13 

San Diego, CA 92152 

Dr. Ton Ho ran 
Xerox frARC 

3333 Coyota HlU Road 
Palo Alto, CA 94304 

Dr. Jobn Morton 
HRC Cognlllvs 

Davslopncnt Unit 
17 Gordon Streat 
London WCIH OAH 
UNITED RINGOON 

Dr. Allan Hunro 
Behavioral Tachnology 
Laboratories - USC 
1845 S. Elena Ave, 4th Floor 
Redondo Beach, CA 90277 
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Spec. AmC. fpr RMtarch, Kxptrl* 
Mncal & Ac»4«flli: Progrm, 

imc (Code ou) 

HAS Ntaplil* (75) 
NlUingCott, TN 

Assistant for NPT Rsstsrch, 

OtvtlopaMt Sludlts 

HATOP 0117 
VMhlnglott, DC M^IO 
AssUtMl lor ParsoniMl 

UgUtlcs Plsimiiig, 

HAVOP 9871 
50772, TIm Psotsgoo 
VasblngtM, be 20350 

Dr. DofwU A. NorMn 
lost I tut* for Cognltlvt Sclooct 
Unlvorslty of CsiifornU 
' U Jollo, CA 9209) 

Olroctor, Trainlof Uboroionr, 

MfBOC (Co4« 05) 
Son OlOfO, CA 92152 

Director, Msapovtr and Porsoaool 
Laboratory, 
Nmc (Co4a 06) 
' San DlofO, CA 92152 

Director, Iwmii factors 

A Orgaaltatlooal SystMS Lai 
NTROC (C04t 07) 

Saa Dlifo* CA 92152 

Library, HftDC 

Code NOIL 

Can Dlago, CA 92152 

Coaaaiidlnc Offlcar, 

Naval lasaarch Laboratory 
Coda 2627 

Washington, DC 20390 

Dr. Harry P. O'Nall, Jr. 
Unlvorslty of Southtrn California 
School of Education — urS 801 
Dtpt. of Iducatlonal 

Psychology and Technology 
Los Angeles, CA 90089-0031 



Office of Naval Msesrch, 

Code n42EP 
800 N. Otiincy Street 
Arlington, VA 22217-5000 

Jffice of Naval Resesrch, 

Code 1U2PT 
800 N. Quincy Street 
Arlington, VA 22217-5000 
(6 Copies) 
PsydMlogUt 
Office of Naval Rasesrch 

Branch Office, London 
Box 39 

PPO Nov vork, NY 09510 

Special AsaUtant f'sr ^«rlne 

Corps Natters, 

ONi Code OONC 
800 N. Quincy St. 
Arlington, VA 22217-5000 

Psychologist 

Office of Naval Research 
Ualsoo Office, Par Ust 
AfO San Praacisco, CA 96503 

Dr. Judith Orasanu 
Amy Research Institute 
5001 glsan h ov e r Avenue 
Alexandria, VA 22333 

Or. Jesse Orlaasky 
Institute for Defense Analyses 
1801 N. Nauregard St. 
Alexandria, VA 22311 

cot R. T. Parlctte 
Chief of Naval Operations 

OP-1126 

Vashlngton, DC 20370-2000 

Dr. Douglas Pearse 

DCIBN 

Box 2000 

Dovnsviev, Ontsrlo 
CANADA 
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Of. Nancy reiiittiigion 
University ol Uiicago 
Graduate School of Btisliiess 
1101 E. 38th SI. 
Chicago, IL 606J; 

Nilitsry Assistant for Training and 
Personnel Technology, 
. OUSO (R A E) 
Rooa 30129, The Pentagon 
Washington, DC 20301 

Or. Ray Perez 

ARI (PERI'II) 

5001 Eisenhower Avenue 

Alexsndria, VA 2233 

Adainistrstive Sciences Oepartaent, 

Naval Postgraduate School 
No )tereyp CA 93940 

Or. Steven Pinker 
Departacnt of Psychology 



Di . iosepti Psotka 
ATTN: PERI-IC 
Aray Rtsearch Institute 
SOOl Eisenhovei Ave. 
Alexandria, VA 22333 

Lt, Jose Puente Ontanills 
C/SsntlsiM Trinidad, 6, A E 
28010 Madrid 
SPAIN 

Or.^ Lynne Reder 
Departaent of Psychology 
Cacnegie-Kcllon University 
Schenley Psrk 
Pittsburgh, (A 1S213 

CC3 Ksren Reider 
Navsl School of Health Sciences 
National Nsval Hedictl Center 
Bldg. Ul 

Vsshington, DC 20814 



glO-018 
N.I.T. 

Caabrldge, KA 02139 

Or. Tjeerd Ploap 

Tvente University of Technology 

OcpartACnt of Education 

P.O. Box 217 

7500 AS ENscueoe 

TBB NBTUERLANOS 

Or. Harths Poison 
Departaent of Psychology 
Caupus Box 346 
University of Colorado 
Boulder, CO 80309 

Or. Peter Poison 
University of Colorado 
Departaent of Psychology 
Boulder, CO 80309 

Or. Steven E. Pol t rock 
MCC 

9430 Research Blvd. 
Echelon Bldg |1 
Austin. TX 787S9~6S09 



Or. rred Reif 
Physics Departaent 
University of CsUfornia 
Berkeley, CA 94720 

Or. Lauren Resnick 
Lcsrning RAO Center 
University of Pittsburgh 
3939 O'Hars Street 
Pittsburgh, PA 1S213 

Or. Jeff Richsrdson 
Executive Director 
Center for Applied AI 
Caapus Box 419 
University of Colorsdo 
Boulder, CO 80309 

Uilliaa Rixxo 

Code 712 NAVTRAEQUIPCEN 

Orlando, PL 328!3 

Or. Andrev ^ Rose 
Aaericsn Institutes 

for Research 
10S5 Thoaas Jefferson St., HV 
Washington, DC 20007 
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Or. llclMr4 SorMttn 
Itevy PtrtOMMl l&D Center 
Smi DI«iO» CA 92152 

Dr. Kacliryii T. Spo«hr 
•rovn Univtrtity 
Otp«rtMi:t of Ptychology 
ProvSdMict, II 02912 

Or. lobtrt Sttmbtrg 
Depart wmt of Psychology 
Tele UnSvereSty 
lox lUf Tela Station 
Nev llavtii, CT 06520 

Dr. Albert Stevens 
Bolt Seranek 4 NevMn, Inc. 
10 Noultoo St. 
Caabridft, HA 02238 

Or. Petil J. Sticha 
Senior Steff Sciantist 
TreSMinf Keaearch Oivialon 
HuaMlO 

1100 S. Vathinf ton 
Alexandria, VA ?2314 

Dr. ThoMa Sticht 

Navy Peraonnel i4D Center 

San Dieto, CA 92152 

Dr. HartlM N. Taylor 

OCIBH 

Box 2000 

Oovnavlev, Ontario 
CANADA 

Dr. David Thiaaen 
DepartMot of (aychology 
Univeraity of Kanaaa 
Uvrence, KS 6604v^ 

Dr. Douflaa Tovne 
Behavioral Technology Lata 
1S45 S. Blena Ave. 
Bedondo Beach, CA 90277 

Dr. Paul Tvohie 
Arey Beaearch Inatitute 
5001 Biaenhover Avenue 
Alaxendrie, VA 22333 



Headquartara, U. S. Karine Corps 
Code NPI-20 
Washington, DC 20380 

Dr. Beth Varren 
Bolt'Berenek A Nevaan, Inc. 
SO Noultoo Street 
Caabridga, NA 02138 

Dr. BarUra Vhite 
Bolt Beranek A NevMn, Inc. 
10 Noultoo Street 
Caabridga, NA 02238 

LCDB Cory deGroot Whitehead 
Chief of Naval Operationa 

DP--112C1 

Washington, DC 20370-2000 

A. B. Winterbauer 
Beaearch Associate 
Blectroaics Division 
Denver Beaearch Institute 
Univeraity Park 
Denver, CO 80208-0454 

Dr. Bohert A. Wisher 

U.S. Aray Institute for the 

Behavior*! and Social Sciencaa 
5001 Bia<viihover Avenue 
AlexaLl.'.a, VA 22333 

Or. Nartin P. Wiakoff 
Navy 7ersonoel BAD Center 
San Ox ^go, CA 92152 

Hr. John B. Wolfe 

Navy Peraonnel BAD Center 

San Diego, CA 92152 

Dr. Wellace Vulfeck, III 
Navy Personnel BAD Center 
San Diego, CA 92152 

Dr. Joe Yaaetuke 

APflBL/LBT 

U»vry API, CO 80230 

Dr. Joaeph t. Young 
Nenory A Cognitive 

Procaaaaa 
National Science Poundation 
Waahington, DC 20550 
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Dr. Ernst Z Rolhkopf 
Am Bell Uboratoi ies 
Roon 2D.AS6 
600 Hountain Avenue 
Hurray HiU. NJ 07974 

Dr. Uillian 8. Rouse 
Georgia Institute ot Technology 
School of Industrial A Systens 
• Engineering 
Atlante, GA 30332 

Ns. Biitta Ruotsalainen 
Generel Headquarters 
Training Section 
Hilitary P'tychology OHice 
PL 91V 

SF-00101 Helsinki 10, FINUND 

Dr. Hichael J. Saeet 
Perceptronica, Inc 
6271 Variel Avenue 
Woodlend Hills, CA 91364 

Dr. Robert Sesnor 
Amy Beaearch Institute 
3001 Biaenhover Avenue 
Alexendrie, VA 22333 

Dr. Roger Schank 

Yele Univeraity 

Computer Science Departaent 

P.O. Box 2158 

Nev Neven, CT 06520 

Dr. Jenet Schofield 
Lcerning RAD Center 
University of Pittsburgh 
Pittaburgh, PA 15260 

Dr. Hare Sebrechts 
Departaent ot Psychology 
Uesleyan University 
Hiddletovn, CT 06475 

dr. Judith Segal 
Boon 819P 
NIB 

1200 19th Street N.U. 
Washington, DC 20206 



Dr. Robert J. Seidel 
US Amy Research Institute 
5001 Eisenhower Ave. 
Alexandria, VA 22333 

Dr. Raesay U. Selden 
Assessment Center 
CCSSD , 
Suite 379 

400 N. Capitol, NU 
Washington, DC 20001 

Dr. Sylvie A. S. Shafto 
National Institute of Education 
12C0 19th Street 
Heil Stop 1806 
Washington, DC 20208 

Dr. tee Shulaan 
Stanford University 
1040 Cathcart Way 
Stanford, CA 94305 

Dr. Zite H Sinutis 
Instructional Technology 
Syateaa Area . 

ARI 

5001 Bisenhover Avenue 
Alexendrie, VA 22333 

Dr. U* Wellece Sinaiko 
Hanpover Reseerch 

end Ao/isory Services 
Saithsonien Institution 
801 North Pitt Street 
Alexendrie, VA 22314 

Dr.. Derek Sleeaan 
Stenford University 
School of Educetion • 
Stenford, CA 94305 

Dr. Bdverd B. Saith 
Bolt Bcrenek A Newaan, Inc. 
50 Houlton Street 
Caabridge, HA 02138 

Dr. Elliot Soloway 

Yele Univer&tty 

Computer Science Departaent 

P.O. Box 2158 

New Haven, CT 06520 
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